Started by upstream project "integration-distribution-mri-test-argon" build number 82 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-9627 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-argon [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-IOW8YXqq1a3J/agent.5298 SSH_AGENT_PID=5299 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-argon@tmp/private_key_12449833166937957082.key (/w/workspace/controller-csit-3node-clustering-tell-all-argon@tmp/private_key_12449833166937957082.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-tell-all-argon/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-argon/test@tmp/jenkins-gitclient-ssh17927565430030786408.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-argon/test@tmp/jenkins-gitclient-ssh15200741198106387765.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 02dd570f7544c8cd6eb17bda775de9bccc89f923 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 02dd570f7544c8cd6eb17bda775de9bccc89f923 # timeout=10 Commit message: "Migrate Get Requests invocations(libraries)" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk c88ead2b4a65ba004398ad07cfe033ae1e467b17 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins3999219968640401907.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-7qvU lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH Generating Requirements File Python 3.11.7 pip 24.0 from /tmp/venv-7qvU/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.3.0 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.34.88 botocore==1.34.88 bs4==0.0.2 cachetools==5.3.3 certifi==2024.2.2 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.6.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.6.1 docker==4.2.2 dogpile.cache==1.3.2 email_validator==2.1.1 filelock==3.13.4 future==1.0.0 gitdb==4.0.11 GitPython==3.1.43 google-auth==2.29.0 httplib2==0.22.0 identify==2.5.36 idna==3.7 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.3 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.21.1 jsonschema-specifications==2023.12.1 keystoneauth1==5.6.0 kubernetes==29.0.0 lftools==0.37.10 lxml==5.2.1 MarkupSafe==2.1.5 msgpack==1.0.8 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.2.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==3.1.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.0.1 oslo.config==9.4.0 oslo.context==5.5.0 oslo.i18n==6.3.0 oslo.log==5.5.1 oslo.serialization==5.4.0 oslo.utils==7.1.0 packaging==24.0 pbr==6.0.0 platformdirs==4.2.0 prettytable==3.10.0 pyasn1==0.6.0 pyasn1_modules==0.4.0 pycparser==2.22 pygerrit2==2.0.15 PyGithub==2.3.0 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.5.0 python-dateutil==2.9.0.post0 python-heatclient==3.5.0 python-jenkins==1.8.2 python-keystoneclient==5.4.0 python-magnumclient==4.4.0 python-novaclient==18.6.0 python-openstackclient==6.6.0 python-swiftclient==4.5.0 PyYAML==6.0.1 referencing==0.34.0 requests==2.31.0 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.18.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.1 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.2.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.4 tqdm==4.66.2 typing_extensions==4.11.0 tzdata==2024.1 urllib3==1.26.18 virtualenv==20.25.3 wcwidth==0.2.13 websocket-client==1.7.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.4.1 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-argon-82 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins411196538583040850.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' job_name: '41374-82' silo: 'releng' [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins3126338859037555902.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-qwqL + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ sort -V +++ tail -n 1 ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-7qvU + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from file:/tmp/.os_lf_venv + /tmp/venv-7qvU/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-7qvU/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH + PATH=/tmp/venv-7qvU/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 409600 | | totalCoresUsed | 100 | | totalInstancesUsed | 36 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-argon + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-argon-82 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-argon/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-tell-all-argon-82 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2024-04-20T23:07:49Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': '29cab4b2-f8d1-42bf-aa9a-440a76938fa5', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-argon-82/29cab4b2-f8d1-42bf-aa9a-440a76938fa5', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-tell-all-argon-82', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}, {'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.170.161', '10.30.171.73', '10.30.170.67']}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': '29cab4b2-f8d1-42bf-aa9a-440a76938fa5', 'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-argon-82', 'job_name': '41374-82', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - ' '20240401-160147.446', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - ' '20230601-180106.003'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': '4b880ecc08984c9b98bda536715d80f5'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-tell-all-argon [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins1319980174341369797.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH SSH not responding on 10.30.170.161. Retrying in 10 seconds... Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. 10.30.170.67 releng-41374-82-0-builder-2.novalocal Successfully copied public keys to slave 10.30.170.67 10.30.171.73 releng-41374-82-0-builder-1.novalocal Successfully copied public keys to slave 10.30.171.73 Ping to 10.30.170.161 successful. SSH not responding on 10.30.170.161. Retrying in 10 seconds... Ping to 10.30.170.161 successful. SSH not responding on 10.30.170.161. Retrying in 10 seconds... Ping to 10.30.170.161 successful. SSH not responding on 10.30.170.161. Retrying in 10 seconds... Ping to 10.30.170.161 successful. SSH not responding on 10.30.170.161. Retrying in 10 seconds... Ping to 10.30.170.161 successful. Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. 10.30.170.161 releng-41374-82-0-builder-0.novalocal Successfully copied public keys to slave 10.30.170.161 Process 6719 ready. Process 6720 ready. Process 6721 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins6310953995504702434.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-a1nZ lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-argon/.robot_venv lf-activate-venv(): INFO: Installing: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-a1nZ/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 6.6 MB/s eta 0:00:00 Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 15.1 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 18.1 MB/s eta 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 6.1 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 26.2 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.13.0/elasticsearch-8.13.0-py3-none-any.whl (451 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.0/451.0 kB 21.9 MB/s eta 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.13.0/elasticsearch_dsl-8.13.0-py3-none-any.whl (88 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.6/88.6 kB 12.7 MB/s eta 0:00:00 Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 1.1 MB/s eta 0:00:00 Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 379.8 kB/s eta 0:00:00 Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 8.4 MB/s eta 0:00:00 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB) Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.7/idna-3.7-py3-none-any.whl (66 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.1/urllib3-2.2.1-py3-none-any.whl (121 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 16.8 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.3.0/robotframework_seleniumlibrary-6.3.0-py2.py3-none-any.whl (97 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.6/97.6 kB 11.9 MB/s eta 0:00:00 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 6.0 MB/s eta 0:00:00 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.0/elastic_transport-8.13.0-py3-none-any.whl (64 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 5.4 MB/s eta 0:00:00 Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 11.2 MB/s eta 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.1/lxml-5.2.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.4.16/regex-2024.4.16-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 13.6 MB/s eta 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 9.8 MB/s eta 0:00:00 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.5/cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.19.0/selenium-4.19.0-py3-none-any.whl (10.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.5/10.5 MB 51.3 MB/s eta 0:00:00 Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 15.8 MB/s eta 0:00:00 Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 14.2 MB/s eta 0:00:00 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.25.0/trio-0.25.0-py3-none-any.whl (467 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.2/467.2 kB 11.0 MB/s eta 0:00:00 Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.11.0/typing_extensions-4.11.0-py3-none-any.whl (34 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB) Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB) Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 9.6 MB/s eta 0:00:00 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55119 sha256=452ed29dc244ed9a9d65b9a08c4536c1b185b16db051bcc34c7b598ecc65ab31 Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=89dd05ac615ed0a8eb5a03285e92f236f042f5f849c73a0694dbdadcbaa6a1a1 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf Building wheel for pyhocon (setup.py): started Building wheel for pyhocon (setup.py): finished with status 'done' Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20865 sha256=087197740c0d47de6d06eaca03138371928750695dfbc5afdef3c58e8c6fea8a Stored in directory: /home/jenkins/.cache/pip/wheels/02/09/4e/04a983205b51f96912ae6fc13f56f3050a586c98200fe36725 Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9953 sha256=503b2717cd38155f8d59ce9c67f05e8e0ba8226cf12d5df845a7d4e3a86dfef3 Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed Building wheel for scapy (setup.py): started Building wheel for scapy (setup.py): finished with status 'done' Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444327 sha256=682d3983bb6c6416b8cea047b73d029e8ef0c1763e9cd792d4d0fd6ede623283 Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15130 sha256=c6e57ee586306dff543bfbb5a57c7f17330c6dd71f3e7bec2fed0a74aea6f700 Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.5 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.0 elasticsearch-8.13.0 elasticsearch-dsl-8.13.0 enum34-1.1.10 h11-0.14.0 idna-3.7 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.2.1 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.4.16 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.3.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.19.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.25.0 trio-websocket-0.11.1 typing_extensions-4.11.0 urllib3-2.2.1 waitress-3.0.0 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0 + pip freeze attrs==23.2.0 bcrypt==4.1.2 beautifulsoup4==4.12.3 certifi==2024.2.2 cffi==1.16.0 charset-normalizer==3.3.2 cryptography==42.0.5 decorator==5.1.1 distlib==0.3.8 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.13.0 elasticsearch==8.13.0 elasticsearch-dsl==8.13.0 enum34==1.1.10 filelock==3.13.4 h11==0.14.0 idna==3.7 ipaddr==2.2.0 isodate==0.6.1 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==2.4 lxml==5.2.1 netaddr==1.2.1 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==3.4.0 platformdirs==4.2.0 ply==3.11 pyang==2.6.0 pyangbind==0.8.5 pycparser==2.22 pyhocon==0.3.60 PyNaCl==1.5.0 pyparsing==3.1.2 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2024.4.16 requests==2.31.0 robotframework==7.0 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.4.1 robotframework-requests==0.9.3 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.3.0 robotframework-sshlibrary==3.8.0 scapy==2.5.0 scp==0.14.5 selenium==4.19.0 six==1.16.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.5 trio==0.25.0 trio-websocket==0.11.1 typing_extensions==4.11.0 urllib3==2.2.1 virtualenv==20.25.3 waitress==3.0.0 WebOb==1.8.7 websocket-client==1.7.0 WebTest==3.0.0 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins9431622758063158111.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-argon-82 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' + for i in "${ADDR[@]}" ++ ssh 10.30.170.161 hostname -s Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + REMHOST=releng-41374-82-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.73 hostname -s Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + REMHOST=releng-41374-82-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.67 hostname -s Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + REMHOST=releng-41374-82-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.170.161 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.170.161 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.171.73 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.170.67 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.170.161 ODL_SYSTEM_1_IP=10.30.170.161 ODL_SYSTEM_2_IP=10.30.171.73 ODL_SYSTEM_3_IP=10.30.170.67 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/sh /tmp/jenkins14522812223322041811.sh Preparing for JRE Version 17 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-17-openjdk [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins6816737830997327435.sh --2024-04-20 23:10:37-- http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/argon Resolving git.opendaylight.org (git.opendaylight.org)... 35.181.223.58, 13.39.230.180, 52.47.161.242, ... Connecting to git.opendaylight.org (git.opendaylight.org)|35.181.223.58|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 2620 (2.6K) [text/plain] Saving to: ‘pom.xml’ 0K .. 100% 205M=0s 2024-04-20 23:10:37 (205 MB/s) - ‘pom.xml’ saved [2620/2620] Bundle version is 0.18.4-SNAPSHOT --2024-04-20 23:10:37-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 62.4M=0s 2024-04-20 23:10:37 (62.4 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.18.4-SNAPSHOT 20240420.194414 171 20240420194414 pom 0.18.4-20240420.194414-171 20240420194414 tar.gz 0.18.4-20240420.194414-171 20240420194414 zip 0.18.4-20240420.194414-171 20240420194414 cyclonedx xml 0.18.4-20240420.194414-171 20240420194414 cyclonedx json 0.18.4-20240420.194414-171 20240420194414 Nexus timestamp is 0.18.4-20240420.194414-171 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip Distribution bundle is karaf-0.18.4-20240420.194414-171.zip Distribution bundle version is 0.18.4-SNAPSHOT Distribution folder is karaf-0.18.4-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins5437201112265329176.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.170.161:/tmp Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.73:/tmp Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.67:/tmp Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins13535451603812406068.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.170.161 Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.171.73 Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.170.67 Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.170.161 Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp + echo 'Changing to /tmp' + cd /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip --2024-04-20 23:10:50-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 260400952 (248M) [application/zip] Saving to: ‘karaf-0.18.4-20240420.194414-171.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 43.6M 6s 3072K ........ ........ ........ ........ ........ ........ 2% 126M 4s 6144K ........ ........ ........ ........ ........ ........ 3% 151M 3s 9216K ........ ........ ........ ........ ........ ........ 4% 141M 3s 12288K ........ ........ ........ ........ ........ ........ 6% 144M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 202M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 218M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 195M 2s 24576K ........ ........ ........ ........ ........ ........ 10% 243M 2s 27648K ........ ........ ........ ........ ........ ........ 12% 242M 2s 30720K ........ ........ ........ ........ ........ ........ 13% 264M 2s 33792K ........ ........ ........ ........ ........ ........ 14% 254M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 300M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 274M 1s 43008K ........ ........ ........ ........ ........ ........ 18% 259M 1s 46080K ........ ........ ........ ........ ........ ........ 19% 251M 1s 49152K ........ ........ ........ ........ ........ ........ 20% 235M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 263M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 237M 1s 58368K ........ ........ ........ ........ ........ ........ 24% 244M 1s 61440K ........ ........ ........ ........ ........ ........ 25% 251M 1s 64512K ........ ........ ........ ........ ........ ........ 26% 185M 1s 67584K ........ ........ ........ ........ ........ ........ 27% 275M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 310M 1s 73728K ........ ........ ........ ........ ........ ........ 30% 243M 1s 76800K ........ ........ ........ ........ ........ ........ 31% 237M 1s 79872K ........ ........ ........ ........ ........ ........ 32% 283M 1s 82944K ........ ........ ........ ........ ........ ........ 33% 332M 1s 86016K ........ ........ ........ ........ ........ ........ 35% 317M 1s 89088K ........ ........ ........ ........ ........ ........ 36% 308M 1s 92160K ........ ........ ........ ........ ........ ........ 37% 310M 1s 95232K ........ ........ ........ ........ ........ ........ 38% 312M 1s 98304K ........ ........ ........ ........ ........ ........ 39% 299M 1s 101376K ........ ........ ........ ........ ........ ........ 41% 295M 1s 104448K ........ ........ ........ ........ ........ ........ 42% 302M 1s 107520K ........ ........ ........ ........ ........ ........ 43% 294M 1s 110592K ........ ........ ........ ........ ........ ........ 44% 290M 1s 113664K ........ ........ ........ ........ ........ ........ 45% 316M 1s 116736K ........ ........ ........ ........ ........ ........ 47% 334M 1s 119808K ........ ........ ........ ........ ........ ........ 48% 324M 1s 122880K ........ ........ ........ ........ ........ ........ 49% 337M 1s 125952K ........ ........ ........ ........ ........ ........ 50% 328M 1s 129024K ........ ........ ........ ........ ........ ........ 51% 336M 1s 132096K ........ ........ ........ ........ ........ ........ 53% 330M 1s 135168K ........ ........ ........ ........ ........ ........ 54% 349M 0s 138240K ........ ........ ........ ........ ........ ........ 55% 329M 0s 141312K ........ ........ ........ ........ ........ ........ 56% 341M 0s 144384K ........ ........ ........ ........ ........ ........ 57% 314M 0s 147456K ........ ........ ........ ........ ........ ........ 59% 332M 0s 150528K ........ ........ ........ ........ ........ ........ 60% 320M 0s 153600K ........ ........ ........ ........ ........ ........ 61% 345M 0s 156672K ........ ........ ........ ........ ........ ........ 62% 323M 0s 159744K ........ ........ ........ ........ ........ ........ 64% 340M 0s 162816K ........ ........ ........ ........ ........ ........ 65% 332M 0s 165888K ........ ........ ........ ........ ........ ........ 66% 341M 0s 168960K ........ ........ ........ ........ ........ ........ 67% 287M 0s 172032K ........ ........ ........ ........ ........ ........ 68% 331M 0s 175104K ........ ........ ........ ........ ........ ........ 70% 369M 0s 178176K ........ ........ ........ ........ ........ ........ 71% 372M 0s 181248K ........ ........ ........ ........ ........ ........ 72% 86.2M 0s 184320K ........ ........ ........ ........ ........ ........ 73% 227M 0s 187392K ........ ........ ........ ........ ........ ........ 74% 357M 0s 190464K ........ ........ ........ ........ ........ ........ 76% 369M 0s 193536K ........ ........ ........ ........ ........ ........ 77% 363M 0s 196608K ........ ........ ........ ........ ........ ........ 78% 353M 0s 199680K ........ ........ ........ ........ ........ ........ 79% 331M 0s 202752K ........ ........ ........ ........ ........ ........ 80% 370M 0s 205824K ........ ........ ........ ........ ........ ........ 82% 363M 0s 208896K ........ ........ ........ ........ ........ ........ 83% 376M 0s 211968K ........ ........ ........ ........ ........ ........ 84% 366M 0s 215040K ........ ........ ........ ........ ........ ........ 85% 375M 0s 218112K ........ ........ ........ ........ ........ ........ 86% 212M 0s 221184K ........ ........ ........ ........ ........ ........ 88% 321M 0s 224256K ........ ........ ........ ........ ........ ........ 89% 292M 0s 227328K ........ ........ ........ ........ ........ ........ 90% 330M 0s 230400K ........ ........ ........ ........ ........ ........ 91% 301M 0s 233472K ........ ........ ........ ........ ........ ........ 93% 373M 0s 236544K ........ ........ ........ ........ ........ ........ 94% 360M 0s 239616K ........ ........ ........ ........ ........ ........ 95% 361M 0s 242688K ........ ........ ........ ........ ........ ........ 96% 353M 0s 245760K ........ ........ ........ ........ ........ ........ 97% 386M 0s 248832K ........ ........ ........ ........ ........ ........ 99% 366M 0s 251904K ........ ........ ........ ........ ..... 100% 355M=1.0s 2024-04-20 23:10:51 (258 MB/s) - ‘karaf-0.18.4-20240420.194414-171.zip’ saved [260400952/260400952] + echo 'Extracting the new controller...' Extracting the new controller... + unzip -q karaf-0.18.4-20240420.194414-171.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.18.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/9c31a8b5-ee87-4683-9b4b-554013217445.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 2b526388-64e8-4b1e-b6c4-8c8e24015758 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS controllerdebugmap: cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.161:22 10.30.170.10:44746 ESTABLISHED - tcp 0 0 10.30.170.161:39476 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.170.161:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.161 10.30.171.73 10.30.170.67 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.161" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.161:2550", "akka://opendaylight-cluster-data@10.30.171.73:2550", "akka://opendaylight-cluster-data@10.30.170.67:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.171.73 Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip --2024-04-20 23:10:54-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 260400952 (248M) [application/zip] Saving to: ‘karaf-0.18.4-20240420.194414-171.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 56.5M 4s 3072K ........ ........ ........ ........ ........ ........ 2% 108M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 145M 3s 9216K ........ ........ ........ ........ ........ ........ 4% 173M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 42.9M 3s 15360K ........ ........ ........ ........ ........ ........ 7% 175M 3s 18432K ........ ........ ........ ........ ........ ........ 8% 220M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 222M 2s 24576K ........ ........ ........ ........ ........ ........ 10% 223M 2s 27648K ........ ........ ........ ........ ........ ........ 12% 265M 2s 30720K ........ ........ ........ ........ ........ ........ 13% 265M 2s 33792K ........ ........ ........ ........ ........ ........ 14% 283M 2s 36864K ........ ........ ........ ........ ........ ........ 15% 246M 2s 39936K ........ ........ ........ ........ ........ ........ 16% 231M 1s 43008K ........ ........ ........ ........ ........ ........ 18% 282M 1s 46080K ........ ........ ........ ........ ........ ........ 19% 349M 1s 49152K ........ ........ ........ ........ ........ ........ 20% 243M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 341M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 368M 1s 58368K ........ ........ ........ ........ ........ ........ 24% 315M 1s 61440K ........ ........ ........ ........ ........ ........ 25% 321M 1s 64512K ........ ........ ........ ........ ........ ........ 26% 373M 1s 67584K ........ ........ ........ ........ ........ ........ 27% 358M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 316M 1s 73728K ........ ........ ........ ........ ........ ........ 30% 346M 1s 76800K ........ ........ ........ ........ ........ ........ 31% 346M 1s 79872K ........ ........ ........ ........ ........ ........ 32% 313M 1s 82944K ........ ........ ........ ........ ........ ........ 33% 343M 1s 86016K ........ ........ ........ ........ ........ ........ 35% 332M 1s 89088K ........ ........ ........ ........ ........ ........ 36% 348M 1s 92160K ........ ........ ........ ........ ........ ........ 37% 179M 1s 95232K ........ ........ ........ ........ ........ ........ 38% 273M 1s 98304K ........ ........ ........ ........ ........ ........ 39% 353M 1s 101376K ........ ........ ........ ........ ........ ........ 41% 345M 1s 104448K ........ ........ ........ ........ ........ ........ 42% 344M 1s 107520K ........ ........ ........ ........ ........ ........ 43% 345M 1s 110592K ........ ........ ........ ........ ........ ........ 44% 349M 1s 113664K ........ ........ ........ ........ ........ ........ 45% 240M 1s 116736K ........ ........ ........ ........ ........ ........ 47% 280M 1s 119808K ........ ........ ........ ........ ........ ........ 48% 323M 1s 122880K ........ ........ ........ ........ ........ ........ 49% 325M 1s 125952K ........ ........ ........ ........ ........ ........ 50% 289M 1s 129024K ........ ........ ........ ........ ........ ........ 51% 304M 1s 132096K ........ ........ ........ ........ ........ ........ 53% 224M 1s 135168K ........ ........ ........ ........ ........ ........ 54% 270M 1s 138240K ........ ........ ........ ........ ........ ........ 55% 326M 0s 141312K ........ ........ ........ ........ ........ ........ 56% 297M 0s 144384K ........ ........ ........ ........ ........ ........ 57% 324M 0s 147456K ........ ........ ........ ........ ........ ........ 59% 159M 0s 150528K ........ ........ ........ ........ ........ ........ 60% 226M 0s 153600K ........ ........ ........ ........ ........ ........ 61% 371M 0s 156672K ........ ........ ........ ........ ........ ........ 62% 380M 0s 159744K ........ ........ ........ ........ ........ ........ 64% 293M 0s 162816K ........ ........ ........ ........ ........ ........ 65% 328M 0s 165888K ........ ........ ........ ........ ........ ........ 66% 325M 0s 168960K ........ ........ ........ ........ ........ ........ 67% 322M 0s 172032K ........ ........ ........ ........ ........ ........ 68% 342M 0s 175104K ........ ........ ........ ........ ........ ........ 70% 211M 0s 178176K ........ ........ ........ ........ ........ ........ 71% 288M 0s 181248K ........ ........ ........ ........ ........ ........ 72% 298M 0s 184320K ........ ........ ........ ........ ........ ........ 73% 170M 0s 187392K ........ ........ ........ ........ ........ ........ 74% 219M 0s 190464K ........ ........ ........ ........ ........ ........ 76% 260M 0s 193536K ........ ........ ........ ........ ........ ........ 77% 276M 0s 196608K ........ ........ ........ ........ ........ ........ 78% 260M 0s 199680K ........ ........ ........ ........ ........ ........ 79% 208M 0s 202752K ........ ........ ........ ........ ........ ........ 80% 216M 0s 205824K ........ ........ ........ ........ ........ ........ 82% 211M 0s 208896K ........ ........ ........ ........ ........ ........ 83% 267M 0s 211968K ........ ........ ........ ........ ........ ........ 84% 162M 0s 215040K ........ ........ ........ ........ ........ ........ 85% 283M 0s 218112K ........ ........ ........ ........ ........ ........ 86% 260M 0s 221184K ........ ........ ........ ........ ........ ........ 88% 200M 0s 224256K ........ ........ ........ ........ ........ ........ 89% 212M 0s 227328K ........ ........ ........ ........ ........ ........ 90% 219M 0s 230400K ........ ........ ........ ........ ........ ........ 91% 230M 0s 233472K ........ ........ ........ ........ ........ ........ 93% 236M 0s 236544K ........ ........ ........ ........ ........ ........ 94% 286M 0s 239616K ........ ........ ........ ........ ........ ........ 95% 196M 0s 242688K ........ ........ ........ ........ ........ ........ 96% 266M 0s 245760K ........ ........ ........ ........ ........ ........ 97% 209M 0s 248832K ........ ........ ........ ........ ........ ........ 99% 250M 0s 251904K ........ ........ ........ .....Extracting the new controller... ... ..... 100% 259M=1.1s 2024-04-20 23:10:55 (233 MB/s) - ‘karaf-0.18.4-20240420.194414-171.zip’ saved [260400952/260400952] + echo 'Extracting the new controller...' + unzip -q karaf-0.18.4-20240420.194414-171.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.18.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/9c31a8b5-ee87-4683-9b4b-554013217445.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 2b526388-64e8-4b1e-b6c4-8c8e24015758 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.73:22 10.30.170.10:32806 ESTABLISHED - tcp 0 0 10.30.171.73:43582 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::111 :::* LISTEN - udp 0 0 10.30.171.73:40152 199.182.221.110:123 ESTABLISHED - udp 0 0 10.30.171.73:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' Copying the shard config... + cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.161 10.30.171.73 10.30.170.67 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.73" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.161:2550", "akka://opendaylight-cluster-data@10.30.171.73:2550", "akka://opendaylight-cluster-data@10.30.170.67:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.170.67 Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp + echo 'Changing to /tmp' + cd /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip --2024-04-20 23:10:59-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 260400952 (248M) [application/zip] Saving to: ‘karaf-0.18.4-20240420.194414-171.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 75.7M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 138M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 58.6M 3s 9216K ........ ........ ........ ........ ........ ........ 4% 222M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 186M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 249M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 201M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 261M 2s 24576K ........ ........ ........ ........ ........ ........ 10% 295M 2s 27648K ........ ........ ........ ........ ........ ........ 12% 302M 1s 30720K ........ ........ ........ ........ ........ ........ 13% 264M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 252M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 283M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 285M 1s 43008K ........ ........ ........ ........ ........ ........ 18% 362M 1s 46080K ........ ........ ........ ........ ........ ........ 19% 295M 1s 49152K ........ ........ ........ ........ ........ ........ 20% 304M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 358M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 365M 1s 58368K ........ ........ ........ ........ ........ ........ 24% 364M 1s 61440K ........ ........ ........ ........ ........ ........ 25% 316M 1s 64512K ........ ........ ........ ........ ........ ........ 26% 254M 1s 67584K ........ ........ ........ ........ ........ ........ 27% 295M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 306M 1s 73728K ........ ........ ........ ........ ........ ........ 30% 246M 1s 76800K ........ ........ ........ ........ ........ ........ 31% 251M 1s 79872K ........ ........ ........ ........ ........ ........ 32% 190M 1s 82944K ........ ........ ........ ........ ........ ........ 33% 308M 1s 86016K ........ ........ ........ ........ ........ ........ 35% 363M 1s 89088K ........ ........ ........ ........ ........ ........ 36% 384M 1s 92160K ........ ........ ........ ........ ........ ........ 37% 207M 1s 95232K ........ ........ ........ ........ ........ ........ 38% 244M 1s 98304K ........ ........ ........ ........ ........ ........ 39% 174M 1s 101376K ........ ........ ........ ........ ........ ........ 41% 256M 1s 104448K ........ ........ ........ ........ ........ ........ 42% 357M 1s 107520K ........ ........ ........ ........ ........ ........ 43% 366M 1s 110592K ........ ........ ........ ........ ........ ........ 44% 354M 1s 113664K ........ ........ ........ ........ ........ ........ 45% 348M 1s 116736K ........ ........ ........ ........ ........ ........ 47% 212M 1s 119808K ........ ........ ........ ........ ........ ........ 48% 259M 1s 122880K ........ ........ ........ ........ ........ ........ 49% 351M 1s 125952K ........ ........ ........ ........ ........ ........ 50% 331M 1s 129024K ........ ........ ........ ........ ........ ........ 51% 350M 1s 132096K ........ ........ ........ ........ ........ ........ 53% 351M 0s 135168K ........ ........ ........ ........ ........ ........ 54% 349M 0s 138240K ........ ........ ........ ........ ........ ........ 55% 197M 0s 141312K ........ ........ ........ ........ ........ ........ 56% 270M 0s 144384K ........ ........ ........ ........ ........ ........ 57% 321M 0s 147456K ........ ........ ........ ........ ........ ........ 59% 364M 0s 150528K ........ ........ ........ ........ ........ ........ 60% 232M 0s 153600K ........ ........ ........ ........ ........ ........ 61% 193M 0s 156672K ........ ........ ........ ........ ........ ........ 62% 280M 0s 159744K ........ ........ ........ ........ ........ ........ 64% 387M 0s 162816K ........ ........ ........ ........ ........ ........ 65% 377M 0s 165888K ........ ........ ........ ........ ........ ........ 66% 370M 0s 168960K ........ ........ ........ ........ ........ ........ 67% 329M 0s 172032K ........ ........ ........ ........ ........ ........ 68% 306M 0s 175104K ........ ........ ........ ........ ........ ........ 70% 337M 0s 178176K ........ ........ ........ ........ ........ ........ 71% 310M 0s 181248K ........ ........ ........ ........ ........ ........ 72% 382M 0s 184320K ........ ........ ........ ........ ........ ........ 73% 380M 0s 187392K ........ ........ ........ ........ ........ ........ 74% 364M 0s 190464K ........ ........ ........ ........ ........ ........ 76% 341M 0s 193536K ........ ........ ........ ........ ........ ........ 77% 351M 0s 196608K ........ ........ ........ ........ ........ ........ 78% 66.7M 0s 199680K ........ ........ ........ ........ ........ ........ 79% 282M 0s 202752K ........ ........ ........ ........ ........ ........ 80% 377M 0s 205824K ........ ........ ........ ........ ........ ........ 82% 393M 0s 208896K ........ ........ ........ ........ ........ ........ 83% 362M 0s 211968K ........ ........ ........ ........ ........ ........ 84% 358M 0s 215040K ........ ........ ........ ........ ........ ........ 85% 350M 0s 218112K ........ ........ ........ ........ ........ ........ 86% 366M 0s 221184K ........ ........ ........ ........ ........ ........ 88% 338M 0s 224256K ........ ........ ........ ........ ........ ........ 89% 283M 0s 227328K ........ ........ ........ ........ ........ ........ 90% 340M 0s 230400K ........ ........ ........ ........ ........ ........ 91% 201M 0s 233472K ........ ........ ........ ........ ........ ........ 93% 166M 0s 236544K ........ ........ ........ ........ ........ ........ 94% 227M 0s 239616K ........ ........ ........ ........ ........ ........ 95% 273M 0s 242688K ........ ........ ........ ........ ........ ........ 96% 301M 0s 245760K ........ ........ ........ ........ ........ ........ 97% 287M 0s 248832K ........ ........ ........ ........ ........ ........ 99% 314M 0s 251904K ........ ........ ........ ...Extracting the new controller... ..... ..... 100% 301M=1.0s 2024-04-20 23:11:00 (254 MB/s) - ‘karaf-0.18.4-20240420.194414-171.zip’ saved [260400952/260400952] + echo 'Extracting the new controller...' + unzip -q karaf-0.18.4-20240420.194414-171.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.18.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/9c31a8b5-ee87-4683-9b4b-554013217445.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 2b526388-64e8-4b1e-b6c4-8c8e24015758 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' controllerdebugmap: cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv Configure + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo ' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.67:22 10.30.170.10:50766 ESTABLISHED - tcp 0 0 10.30.170.67:44538 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::111 :::* LISTEN - udp 0 0 10.30.170.67:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.161 10.30.171.73 10.30.170.67 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.67" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.161:2550", "akka://opendaylight-cluster-data@10.30.171.73:2550", "akka://opendaylight-cluster-data@10.30.170.67:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.170.161 Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.171.73 Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.170.67 Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins8859588159275836047.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.170.161' Execute the post startup script on controller 10.30.170.161 + scp /w/workspace/controller-csit-3node-clustering-tell-all-argon/post-startup-script.sh 10.30.170.161:/tmp/ Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + ssh 10.30.170.161 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-20T23:12:05,448 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-20T23:12:05,448 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.170.161:22 10.30.170.10:33224 ESTABLISHED - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5769/java tcp6 0 0 :::6653 :::* LISTEN 5769/java tcp6 0 0 :::4189 :::* LISTEN 5769/java tcp6 0 0 :::1790 :::* LISTEN 5769/java tcp6 0 0 127.0.0.1:45889 :::* LISTEN 5769/java tcp6 0 0 :::8101 :::* LISTEN 5769/java tcp6 0 0 :::6633 :::* LISTEN 5769/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5769/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5769/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5769/java tcp6 0 0 10.30.170.161:2550 :::* LISTEN 5769/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 10.30.170.161:2550 10.30.170.67:36286 ESTABLISHED 5769/java tcp6 0 0 10.30.170.161:2550 10.30.171.73:59042 ESTABLISHED 5769/java tcp6 0 0 10.30.170.161:50594 10.30.170.67:2550 ESTABLISHED 5769/java tcp6 0 0 10.30.170.161:2550 10.30.170.67:36276 ESTABLISHED 5769/java tcp6 0 0 10.30.170.161:45318 10.30.171.73:2550 ESTABLISHED 5769/java tcp6 32 0 10.30.170.161:51692 199.204.45.87:443 CLOSE_WAIT 5769/java tcp6 0 0 10.30.170.161:45306 10.30.171.73:2550 ESTABLISHED 5769/java tcp6 0 0 10.30.170.161:2550 10.30.171.73:59028 ESTABLISHED 5769/java tcp6 0 0 127.0.0.1:57722 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 127.0.0.1:57708 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.161:50582 10.30.170.67:2550 ESTABLISHED 5769/java tcp6 0 0 127.0.0.1:60722 127.0.0.1:1099 TIME_WAIT - udp 0 0 10.30.170.161:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5769/java (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.171.73' Execute the post startup script on controller 10.30.171.73 + scp /w/workspace/controller-csit-3node-clustering-tell-all-argon/post-startup-script.sh 10.30.171.73:/tmp/ Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + ssh 10.30.171.73 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-20T23:12:05,642 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-20T23:12:05,642 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.73:22 10.30.170.10:36436 ESTABLISHED - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5733/java tcp6 0 0 10.30.171.73:2550 :::* LISTEN 5733/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5733/java tcp6 0 0 :::6653 :::* LISTEN 5733/java tcp6 0 0 :::1790 :::* LISTEN 5733/java tcp6 0 0 :::8101 :::* LISTEN 5733/java tcp6 0 0 127.0.0.1:40711 :::* LISTEN 5733/java tcp6 0 0 :::6633 :::* LISTEN 5733/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5733/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5733/java tcp6 0 0 10.30.171.73:59168 10.30.170.67:2550 ESTABLISHED 5733/java tcp6 0 0 10.30.171.73:59042 10.30.170.161:2550 ESTABLISHED 5733/java tcp6 0 0 127.0.0.1:41856 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 127.0.0.1:41846 127.0.0.1:44444 TIME_WAIT - tcp6 32 0 10.30.171.73:38950 199.204.45.87:443 CLOSE_WAIT 5733/java tcp6 0 0 10.30.171.73:59028 10.30.170.161:2550 ESTABLISHED 5733/java tcp6 0 0 10.30.171.73:2550 10.30.170.161:45306 ESTABLISHED 5733/java tcp6 0 0 127.0.0.1:43914 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.73:2550 10.30.170.161:45318 ESTABLISHED 5733/java tcp6 0 0 10.30.171.73:2550 10.30.170.67:54236 ESTABLISHED 5733/java tcp6 0 0 10.30.171.73:59164 10.30.170.67:2550 ESTABLISHED 5733/java tcp6 0 0 10.30.171.73:2550 10.30.170.67:54242 ESTABLISHED 5733/java udp 0 0 10.30.171.73:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5733/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.170.67' Execute the post startup script on controller 10.30.170.67 + scp /w/workspace/controller-csit-3node-clustering-tell-all-argon/post-startup-script.sh 10.30.170.67:/tmp/ Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + ssh 10.30.170.67 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-20T23:12:05,113 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-20T23:12:05,113 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 10.30.170.67:22 10.30.170.10:56380 ESTABLISHED - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5742/java tcp6 0 0 10.30.170.67:2550 :::* LISTEN 5742/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5742/java tcp6 0 0 :::6653 :::* LISTEN 5742/java tcp6 0 0 :::1790 :::* LISTEN 5742/java tcp6 0 0 127.0.0.1:33889 :::* LISTEN 5742/java tcp6 0 0 :::8101 :::* LISTEN 5742/java tcp6 0 0 :::6633 :::* LISTEN 5742/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5742/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5742/java tcp6 0 0 10.30.170.67:36276 10.30.170.161:2550 ESTABLISHED 5742/java tcp6 32 0 10.30.170.67:44546 199.204.45.87:443 CLOSE_WAIT 5742/java tcp6 0 0 10.30.170.67:2550 10.30.170.161:50582 ESTABLISHED 5742/java tcp6 0 0 10.30.170.67:2550 10.30.170.161:50594 ESTABLISHED 5742/java tcp6 0 0 10.30.170.67:54236 10.30.171.73:2550 ESTABLISHED 5742/java tcp6 0 0 127.0.0.1:40980 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.170.67:2550 10.30.171.73:59168 ESTABLISHED 5742/java tcp6 0 0 127.0.0.1:40290 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.67:54242 10.30.171.73:2550 ESTABLISHED 5742/java tcp6 0 0 10.30.170.67:2550 10.30.171.73:59164 ESTABLISHED 5742/java tcp6 0 0 10.30.170.67:36286 10.30.170.161:2550 ESTABLISHED 5742/java udp 0 0 10.30.170.67:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5742/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.161 'sudo ps aux' Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5769 + echo 'karaf main: org.apache.karaf.main.Main, pid:5769' karaf main: org.apache.karaf.main.Main, pid:5769 + ssh 10.30.170.161 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5769' Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.73 'sudo ps aux' Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_before.log ++ cut -f2 '-d ' ++ grep -v grep ++ tr -s ' ' + pid=5733 + echo 'karaf main: org.apache.karaf.main.Main, pid:5733' karaf main: org.apache.karaf.main.Main, pid:5733 + ssh 10.30.171.73 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5733' Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.67 'sudo ps aux' Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5742 + echo 'karaf main: org.apache.karaf.main.Main, pid:5742' karaf main: org.apache.karaf.main.Main, pid:5742 + ssh 10.30.170.67 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5742' Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.161' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.161 -v ODL_SYSTEM_2_IP:10.30.171.73' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.161 -v ODL_SYSTEM_2_IP:10.30.171.73 -v ODL_SYSTEM_3_IP:10.30.170.67' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell-argon.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell-argon.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-argon: /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell.txt + cat testplan.txt # Place the suites in run order: # disabling all "prefix based" suites. This functionality was newly # introduced with these tests in 2017. The assumption is that # development stopped in that area, but may continue at a later # time. Still, the tests are failing and no resources to solve the # failures at this time. If/When this changes, we can uncomment # those suites. Note that every suite is commented out with it's # accompanying "restart_with_tell_based_true" setup suite. # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_argon -v BUNDLEFOLDER:karaf-0.18.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240420.194414-171.zip -v CONTROLLER:10.30.170.161 -v CONTROLLER1:10.30.171.73 -v CONTROLLER2:10.30.170.67 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-argon -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:argon -v ODL_SYSTEM_IP:10.30.170.161 -v ODL_SYSTEM_1_IP:10.30.170.161 -v ODL_SYSTEM_2_IP:10.30.171.73 -v ODL_SYSTEM_3_IP:10.30.170.67 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-tell.txt ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes... ============================================================================== Get_Shard_Role :: Get shard role. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.170.161:8181/restconf/operations/cluster-admin:get-shard-role ------------------------------------------------------------------------------ Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Make_Leader_Local :: Make the loeader local and verify. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Leader :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Follower :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_All_Nodes :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status" Resolving variable '${response.text}' failed: AttributeError: 'ReadTimeout' object has no attribute 'text' ------------------------------------------------------------------------------ controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL | 9 tests, 0 passed, 9 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi... ============================================================================== Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.161', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te... ============================================================================== Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.161', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart2 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.161', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L... ============================================================================== Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.161', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C... ============================================================================== Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) 2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 3) Resolving variable '${response.status_code}' failed: AttributeError: 'No... [ Message content over the limit has been removed. ] 65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 67) TypeError: Expected argument 1 to be a dictionary, got None instead. 68) TypeError: Expected argument 1 to be a dictionary, got None instead. 69) Unrecognized Raft state: None 70) No leader found. 71) Too many Leaders. 72) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.161', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.161', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.161', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.161', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart_2 :: Restart odl. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_restart_2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.161', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.67', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic... ============================================================================== Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Persistence Recovery :: This test restar... ============================================================================== Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover :: This test focuses on test... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe... ============================================================================== Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.161:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test... ============================================================================== Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.73:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-tell.txt | FAIL | 162 tests, 11 passed, 151 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-tell-all-argon/output.xml Log: /w/workspace/controller-csit-3node-clustering-tell-all-argon/log.html Report: /w/workspace/controller-csit-3node-clustering-tell-all-argon/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.170.161 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. total 68548 drwxrwxr-x. 2 jenkins jenkins 48 Apr 20 23:11 . -rw-rw-r--. 1 jenkins jenkins 1720 Apr 20 23:11 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Apr 21 04:47 .. -rw-rw-r--. 1 jenkins jenkins 68398338 Apr 21 05:01 karaf.log + ssh 10.30.170.161 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log 67M /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log + ssh 10.30.171.73 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. total 64964 drwxrwxr-x. 2 jenkins jenkins 48 Apr 20 23:11 . -rw-rw-r--. 1 jenkins jenkins 1720 Apr 20 23:11 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Apr 21 04:47 .. -rw-rw-r--. 1 jenkins jenkins 63176583 Apr 21 05:01 karaf.log + ssh 10.30.171.73 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log 64M /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log + ssh 10.30.170.67 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. total 131172 drwxrwxr-x. 2 jenkins jenkins 48 Apr 20 23:11 . -rw-rw-r--. 1 jenkins jenkins 166746 Apr 20 23:19 karaf_console.log drwxrwxr-x. 4 jenkins jenkins 28 Apr 21 04:47 .. -rw-rw-r--. 1 jenkins jenkins 85190761 Apr 21 05:01 karaf.log + ssh 10.30.170.67 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. 164K /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log 128M /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.161 'sudo ps aux' Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=30703 + echo 'karaf main: org.apache.karaf.main.Main, pid:30703' karaf main: org.apache.karaf.main.Main, pid:30703 + ssh 10.30.170.161 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 30703' Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.161 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.73 'sudo ps aux' Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=28990 + echo 'karaf main: org.apache.karaf.main.Main, pid:28990' karaf main: org.apache.karaf.main.Main, pid:28990 + ssh 10.30.171.73 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 28990' Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.73 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.67 'sudo ps aux' Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5742 + echo 'karaf main: org.apache.karaf.main.Main, pid:5742' karaf main: org.apache.karaf.main.Main, pid:5742 + ssh 10.30.170.67 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5742' Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.67 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.170.161 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.170.161:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + ssh 10.30.170.161 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + scp 10.30.170.161:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + ssh 10.30.170.161 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.170.161:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.170.161' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.171.73 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.171.73:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + ssh 10.30.171.73 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + scp 10.30.171.73:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + ssh 10.30.171.73 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.171.73:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.171.73' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.170.67 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.170.67:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + ssh 10.30.170.67 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + scp 10.30.170.67:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + ssh 10.30.170.67 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.170.67:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.170.67' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 72184 drwxrwxr-x. 2 jenkins jenkins 6 Apr 21 05:02 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 166746 Apr 21 05:02 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 1848225 Apr 21 05:02 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Apr 21 05:02 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 21 05:02 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 2140206 Apr 21 05:02 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Apr 21 05:02 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 21 05:02 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 2331821 Apr 21 05:02 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 164479 Apr 21 05:01 karaf_3_5742_threads_after.log -rw-rw-r--. 1 jenkins jenkins 15568 Apr 21 05:01 ps_after.log -rw-rw-r--. 1 jenkins jenkins 149140 Apr 21 05:01 karaf_2_28990_threads_after.log -rw-rw-r--. 1 jenkins jenkins 162428 Apr 21 05:01 karaf_1_30703_threads_after.log -rw-rw-r--. 1 jenkins jenkins 306078 Apr 21 05:01 report.html -rw-rw-r--. 1 jenkins jenkins 3475414 Apr 21 05:01 log.html -rw-rw-r--. 1 jenkins jenkins 62498932 Apr 21 05:01 output.xml -rw-rw-r--. 1 jenkins jenkins 5952 Apr 20 23:12 testplan.txt -rw-rw-r--. 1 jenkins jenkins 180495 Apr 20 23:12 karaf_3_5742_threads_before.log -rw-rw-r--. 1 jenkins jenkins 16861 Apr 20 23:12 ps_before.log -rw-rw-r--. 1 jenkins jenkins 179567 Apr 20 23:12 karaf_2_5733_threads_before.log -rw-rw-r--. 1 jenkins jenkins 175796 Apr 20 23:12 karaf_1_5769_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Apr 20 23:11 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Apr 20 23:10 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3453 Apr 20 23:10 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Apr 20 23:10 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 133 Apr 20 23:10 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 337 Apr 20 23:10 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2620 Apr 20 23:10 pom.xml -rw-rw-r--. 1 jenkins jenkins 86 Apr 20 23:10 set_variables.env -rw-rw-r--. 1 jenkins jenkins 312 Apr 20 23:10 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Apr 20 23:10 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Apr 20 23:10 env.properties -rw-rw-r--. 1 jenkins jenkins 335 Apr 20 23:07 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Apr 20 23:05 test drwxrwxr-x. 2 jenkins jenkins 6 Apr 20 23:05 test@tmp -rw-rw-r--. 1 jenkins jenkins 1410 Apr 20 19:44 maven-metadata.xml + true [controller-csit-3node-clustering-tell-all-argon] $ /bin/sh /tmp/jenkins12067342308504584809.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5299 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins11008520084963425561.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 840k 0 840k 0 0 4640k 0 --:--:-- --:--:-- --:--:-- 4615k 100 4901k 0 4901k 0 0 4791k 0 --:--:-- 0:00:01 --:--:-- 4791k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins10026551625891739651.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-argon-82 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins12213486470532588684.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-argon-82 DEBUG: Successfully retrieved stack cost: total: 1.98 INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-argon-82 Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-argon-82 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins12863419422856346302.sh ---> sysstat.sh [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins18256847117972353567.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-argon + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-argon ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-argon ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-argon/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-argon/archives/ [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins3590246864655466211.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins213833905320138845.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-argon #82 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-argon@tmp/config3688799196397148902tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins351935681566164247.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins1965964583770014871.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins713345652137201012.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins17220582214373522012.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH DEBUG: total: 1.98 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins17515532852630177132.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-7qvU from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-7qvU/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-argon/82/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-9627.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.996 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 9.6G 31G 24% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 648 4591 19 2456 6751 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:49:e1:c2 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.10/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 64868sec preferred_lft 64868sec inet6 fe80::f816:3eff:fe49:e1c2/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-9627.novalocal) 04/21/2024 _x86_64_ (2 CPU) 12:00:00 AM tps rtps wtps bread/s bwrtn/s 12:00:01 AM 3.70 2.22 1.48 53.33 46.67 12:01:01 AM 18.76 11.06 7.70 165.41 4142.02 12:02:01 AM 1.45 0.07 1.38 1.73 1123.13 12:03:01 AM 0.22 0.00 0.22 0.00 22.96 12:04:01 AM 0.12 0.00 0.12 0.00 3.60 12:05:01 AM 0.15 0.00 0.15 0.00 1.55 12:06:01 AM 0.25 0.00 0.25 0.00 6.53 12:07:01 AM 0.15 0.00 0.15 0.00 1.45 12:08:01 AM 0.43 0.07 0.37 7.60 9.22 12:09:01 AM 0.28 0.00 0.28 0.00 7.07 12:10:01 AM 0.32 0.00 0.32 0.00 5.15 12:11:01 AM 0.23 0.00 0.23 0.00 9.42 12:12:01 AM 0.22 0.00 0.22 0.00 6.41 12:13:01 AM 0.12 0.00 0.12 0.00 1.32 12:14:01 AM 0.13 0.00 0.13 0.00 0.93 12:15:01 AM 0.33 0.00 0.33 0.00 5.82 12:16:01 AM 0.22 0.00 0.22 0.00 3.65 12:17:01 AM 0.20 0.00 0.20 0.00 11.51 12:18:01 AM 0.13 0.00 0.13 0.00 15.06 12:19:01 AM 0.10 0.00 0.10 0.00 6.95 12:20:01 AM 0.30 0.00 0.30 0.00 16.54 12:21:01 AM 0.30 0.00 0.30 0.00 20.63 12:22:01 AM 0.27 0.00 0.27 0.00 10.40 12:23:02 AM 0.43 0.00 0.43 0.00 15.90 12:24:01 AM 0.39 0.00 0.39 0.00 5.57 12:25:01 AM 0.35 0.00 0.35 0.00 4.18 12:26:01 AM 0.47 0.00 0.47 0.00 12.70 12:27:01 AM 0.43 0.00 0.43 0.00 14.43 12:28:01 AM 0.12 0.00 0.12 0.00 7.73 12:29:01 AM 0.12 0.00 0.12 0.00 12.80 12:30:01 AM 0.23 0.00 0.23 0.00 18.73 12:31:01 AM 0.43 0.00 0.43 0.00 15.16 12:32:01 AM 0.25 0.00 0.25 0.00 16.03 12:33:01 AM 0.20 0.00 0.20 0.00 20.96 12:34:01 AM 0.18 0.00 0.18 0.00 8.82 12:35:01 AM 0.20 0.00 0.20 0.00 3.65 12:36:01 AM 0.22 0.00 0.22 0.00 3.25 12:37:01 AM 0.20 0.00 0.20 0.00 4.53 12:38:01 AM 0.10 0.00 0.10 0.00 0.65 12:39:01 AM 0.22 0.00 0.22 0.00 5.21 12:40:01 AM 0.32 0.00 0.32 0.00 4.52 12:41:01 AM 0.23 0.00 0.23 0.00 9.30 12:42:01 AM 0.25 0.00 0.25 0.00 7.45 12:43:01 AM 0.12 0.00 0.12 0.00 1.18 12:44:01 AM 0.17 0.00 0.17 0.00 2.35 12:45:01 AM 0.25 0.00 0.25 0.00 13.08 12:46:01 AM 0.53 0.00 0.53 0.00 19.41 12:47:01 AM 0.48 0.00 0.48 0.00 15.65 12:48:01 AM 0.53 0.00 0.53 0.00 17.44 12:49:01 AM 0.50 0.00 0.50 0.00 15.55 12:50:01 AM 1.48 0.30 1.18 6.40 33.26 12:51:01 AM 0.78 0.00 0.78 0.00 20.13 12:52:01 AM 0.25 0.00 0.25 0.00 3.85 12:53:01 AM 0.13 0.00 0.13 0.00 11.46 12:54:01 AM 0.13 0.00 0.13 0.00 12.40 12:55:01 AM 0.15 0.00 0.15 0.00 8.38 12:56:01 AM 0.25 0.00 0.25 0.00 18.40 12:57:01 AM 0.15 0.00 0.15 0.00 14.40 12:58:01 AM 0.12 0.00 0.12 0.00 7.46 12:59:01 AM 0.27 0.00 0.27 0.00 14.51 01:00:01 AM 0.27 0.03 0.23 0.27 10.56 01:01:01 AM 0.33 0.00 0.33 0.00 17.56 01:02:01 AM 0.63 0.00 0.63 0.00 19.06 01:03:01 AM 0.32 0.00 0.32 0.00 14.80 01:04:01 AM 0.22 0.00 0.22 0.00 13.33 01:05:01 AM 0.18 0.00 0.18 0.00 11.31 01:06:01 AM 0.23 0.00 0.23 0.00 11.06 01:07:01 AM 0.15 0.00 0.15 0.00 24.13 01:08:01 AM 0.12 0.00 0.12 0.00 3.60 01:09:01 AM 0.13 0.00 0.13 0.00 1.83 01:10:01 AM 0.52 0.00 0.52 0.00 10.43 01:11:01 AM 0.35 0.00 0.35 0.00 5.65 01:12:01 AM 0.17 0.00 0.17 0.00 4.70 01:13:01 AM 0.13 0.00 0.13 0.00 0.97 01:14:01 AM 0.17 0.00 0.17 0.00 7.60 01:15:01 AM 0.17 0.00 0.17 0.00 2.93 01:16:01 AM 0.22 0.00 0.22 0.00 5.47 01:17:01 AM 0.23 0.00 0.23 0.00 3.03 01:18:01 AM 0.18 0.00 0.18 0.00 4.02 01:19:01 AM 0.13 0.00 0.13 0.00 16.00 01:20:01 AM 0.25 0.00 0.25 0.00 8.90 01:21:01 AM 0.38 0.00 0.38 0.00 19.73 01:22:01 AM 0.20 0.00 0.20 0.00 16.68 01:23:01 AM 0.50 0.00 0.50 0.00 17.48 01:24:01 AM 0.63 0.00 0.63 0.00 19.20 01:25:01 AM 0.48 0.00 0.48 0.00 10.85 01:26:01 AM 0.27 0.00 0.27 0.00 10.41 01:27:01 AM 0.13 0.00 0.13 0.00 10.13 01:28:01 AM 0.27 0.00 0.27 0.00 18.78 01:29:01 AM 0.30 0.00 0.30 0.00 16.55 01:30:01 AM 0.37 0.00 0.37 0.00 13.81 01:31:02 AM 0.37 0.00 0.37 0.00 19.11 01:32:01 AM 0.22 0.00 0.22 0.00 11.27 01:33:01 AM 0.13 0.00 0.13 0.00 22.15 01:34:01 AM 0.27 0.00 0.27 0.00 5.65 01:35:01 AM 0.40 0.00 0.40 0.00 3.97 01:36:01 AM 0.43 0.00 0.43 0.00 8.70 01:37:01 AM 0.33 0.00 0.33 0.00 3.42 01:38:01 AM 0.35 0.00 0.35 0.00 7.15 01:39:01 AM 0.12 0.00 0.12 0.00 1.17 01:40:01 AM 0.17 0.00 0.17 0.00 2.62 01:41:01 AM 0.25 0.00 0.25 0.00 10.60 01:42:01 AM 0.18 0.00 0.18 0.00 4.92 01:43:01 AM 0.12 0.00 0.12 0.00 0.90 01:44:01 AM 0.12 0.00 0.12 0.00 3.22 01:45:01 AM 0.35 0.00 0.35 0.00 5.27 01:46:01 AM 0.22 0.00 0.22 0.00 5.91 01:47:01 AM 0.15 0.00 0.15 0.00 1.85 01:48:01 AM 0.15 0.00 0.15 0.00 3.83 01:49:01 AM 0.83 0.00 0.83 0.00 14.30 01:50:01 AM 0.20 0.00 0.20 0.00 3.13 01:51:01 AM 0.37 0.00 0.37 0.00 8.70 01:52:01 AM 0.23 0.00 0.23 0.00 2.98 01:53:01 AM 0.17 0.00 0.17 0.00 4.15 01:54:01 AM 0.08 0.00 0.08 0.00 0.72 01:55:01 AM 0.18 0.00 0.18 0.00 4.38 01:56:01 AM 0.25 0.00 0.25 0.00 4.75 01:57:01 AM 0.22 0.00 0.22 0.00 13.88 01:58:01 AM 0.25 0.00 0.25 0.00 9.35 01:59:01 AM 0.23 0.00 0.23 0.00 14.98 02:00:01 AM 0.18 0.00 0.18 0.00 16.64 02:01:01 AM 0.32 0.00 0.32 0.00 13.05 02:02:01 AM 0.33 0.00 0.33 0.00 19.38 02:03:01 AM 0.20 0.00 0.20 0.00 14.68 02:04:01 AM 0.18 0.00 0.18 0.00 3.23 02:05:01 AM 0.27 0.00 0.27 0.00 5.71 02:06:01 AM 0.43 0.00 0.43 0.00 9.20 02:07:01 AM 0.20 0.00 0.20 0.00 2.27 02:08:01 AM 0.10 0.00 0.10 0.00 0.77 02:09:01 AM 0.12 0.00 0.12 0.00 3.90 02:10:01 AM 0.18 0.00 0.18 0.00 1.70 02:11:01 AM 0.33 0.00 0.33 0.00 8.57 02:12:01 AM 0.22 0.00 0.22 0.00 3.45 02:13:01 AM 0.20 0.00 0.20 0.00 4.70 02:14:01 AM 0.42 0.00 0.42 0.00 4.32 02:15:01 AM 0.23 0.00 0.23 0.00 5.75 02:16:01 AM 0.27 0.00 0.27 0.00 4.65 02:17:01 AM 0.13 0.00 0.13 0.00 4.52 02:18:01 AM 0.15 0.00 0.15 0.00 17.05 02:19:01 AM 0.37 0.00 0.37 0.00 11.55 02:20:01 AM 0.22 0.00 0.22 0.00 15.19 02:21:01 AM 0.27 0.00 0.27 0.00 17.63 02:22:01 AM 0.17 0.00 0.17 0.00 8.26 02:23:01 AM 0.13 0.00 0.13 0.00 15.33 02:24:01 AM 0.17 0.00 0.17 0.00 10.03 02:25:01 AM 0.13 0.00 0.13 0.00 1.47 02:26:01 AM 0.40 0.00 0.40 0.00 6.15 02:27:01 AM 0.23 0.00 0.23 0.00 5.90 02:28:01 AM 0.10 0.00 0.10 0.00 0.77 02:29:01 AM 0.13 0.00 0.13 0.00 4.13 02:30:01 AM 0.13 0.00 0.13 0.00 1.68 02:31:01 AM 0.35 0.00 0.35 0.00 7.78 02:32:01 AM 0.47 0.00 0.47 0.00 8.81 02:33:01 AM 0.25 0.00 0.25 0.00 3.60 02:34:01 AM 0.22 0.00 0.22 0.00 2.28 02:35:01 AM 0.40 0.00 0.40 0.00 7.78 02:36:01 AM 0.48 0.00 0.48 0.00 6.31 02:37:01 AM 0.37 0.00 0.37 0.00 10.26 02:38:02 AM 0.20 0.00 0.20 0.00 10.28 02:39:01 AM 0.22 0.00 0.22 0.00 16.32 02:40:01 AM 0.22 0.00 0.22 0.00 9.82 02:41:01 AM 0.37 0.00 0.37 0.00 19.51 02:42:01 AM 0.23 0.00 0.23 0.00 16.01 02:43:01 AM 0.13 0.00 0.13 0.00 16.26 02:44:01 AM 0.15 0.00 0.15 0.00 5.06 02:45:01 AM 0.20 0.00 0.20 0.00 3.52 02:46:01 AM 0.22 0.00 0.22 0.00 3.23 02:47:01 AM 0.17 0.00 0.17 0.00 4.95 02:48:01 AM 0.13 0.00 0.13 0.00 1.47 02:49:01 AM 0.15 0.00 0.15 0.00 4.52 02:50:01 AM 0.32 0.00 0.32 0.00 5.28 02:51:01 AM 0.27 0.00 0.27 0.00 6.98 02:52:01 AM 0.17 0.00 0.17 0.00 2.25 02:53:01 AM 0.15 0.00 0.15 0.00 4.52 02:54:01 AM 0.12 0.00 0.12 0.00 1.20 02:55:01 AM 0.27 0.00 0.27 0.00 6.93 02:56:01 AM 0.18 0.00 0.18 0.00 3.33 02:57:01 AM 0.23 0.00 0.23 0.00 10.51 02:58:01 AM 0.20 0.00 0.20 0.00 14.16 02:59:01 AM 0.32 0.00 0.32 0.00 14.73 03:00:01 AM 0.25 0.00 0.25 0.00 11.43 03:01:01 AM 0.28 0.00 0.28 0.00 18.72 03:02:01 AM 0.35 0.00 0.35 0.00 16.20 03:03:01 AM 0.13 0.00 0.13 0.00 9.60 03:04:01 AM 0.15 0.00 0.15 0.00 23.06 03:05:01 AM 0.32 0.00 0.32 0.00 6.62 03:06:01 AM 0.45 0.00 0.45 0.00 6.27 03:07:01 AM 0.22 0.00 0.22 0.00 4.48 03:08:01 AM 0.18 0.00 0.18 0.00 2.52 03:09:01 AM 0.15 0.00 0.15 0.00 3.87 03:10:01 AM 0.22 0.00 0.22 0.00 2.95 03:11:01 AM 0.45 0.00 0.45 0.00 7.70 03:12:01 AM 0.82 0.03 0.78 1.07 568.43 03:13:01 AM 3.12 0.00 3.12 0.00 1211.21 03:14:01 AM 0.72 0.00 0.72 0.00 12.03 03:15:01 AM 0.35 0.00 0.35 0.00 4.91 03:16:01 AM 0.40 0.00 0.40 0.00 16.81 03:17:01 AM 0.23 0.00 0.23 0.00 14.27 03:18:01 AM 0.27 0.00 0.27 0.00 16.85 03:19:01 AM 0.53 0.00 0.53 0.00 16.44 03:20:01 AM 0.52 0.00 0.52 0.00 16.51 03:21:01 AM 0.58 0.00 0.58 0.00 19.20 03:22:01 AM 0.30 0.00 0.30 0.00 7.86 03:23:01 AM 0.25 0.00 0.25 0.00 6.40 03:24:01 AM 0.22 0.00 0.22 0.00 13.55 03:25:01 AM 0.17 0.00 0.17 0.00 13.18 03:26:01 AM 0.25 0.00 0.25 0.00 17.35 03:27:01 AM 0.17 0.00 0.17 0.00 8.41 03:28:01 AM 0.25 0.00 0.25 0.00 17.66 03:29:01 AM 0.22 0.00 0.22 0.00 15.61 03:30:01 AM 0.15 0.00 0.15 0.00 3.98 03:31:01 AM 0.38 0.00 0.38 0.00 18.43 03:32:01 AM 0.28 0.00 0.28 0.00 15.48 03:33:01 AM 0.25 0.00 0.25 0.00 15.18 03:34:01 AM 0.22 0.00 0.22 0.00 10.38 03:35:01 AM 0.17 0.00 0.17 0.00 14.51 03:36:01 AM 0.22 0.00 0.22 0.00 17.60 03:37:01 AM 0.15 0.00 0.15 0.00 24.80 03:38:01 AM 0.20 0.00 0.20 0.00 5.60 03:39:01 AM 0.12 0.00 0.12 0.00 1.33 03:40:01 AM 0.27 0.00 0.27 0.00 2.86 03:41:01 AM 0.33 0.00 0.33 0.00 8.08 03:42:01 AM 0.15 0.00 0.15 0.00 1.83 03:43:01 AM 0.12 0.00 0.12 0.00 3.60 03:44:01 AM 0.10 0.00 0.10 0.00 1.03 03:45:01 AM 0.17 0.00 0.17 0.00 7.17 03:46:01 AM 0.23 0.00 0.23 0.00 9.91 03:47:01 AM 0.25 0.00 0.25 0.00 3.98 03:48:01 AM 0.17 0.00 0.17 0.00 1.58 03:49:01 AM 0.12 0.00 0.12 0.00 2.80 03:50:01 AM 0.23 0.00 0.23 0.00 6.88 03:51:01 AM 0.23 0.00 0.23 0.00 5.66 03:52:01 AM 0.23 0.00 0.23 0.00 9.48 03:53:01 AM 0.18 0.00 0.18 0.00 2.52 03:54:01 AM 0.22 0.00 0.22 0.00 7.20 03:55:01 AM 0.32 0.00 0.32 0.00 14.53 03:56:01 AM 0.23 0.00 0.23 0.00 15.63 03:57:01 AM 0.48 0.00 0.48 0.00 16.51 03:58:01 AM 0.47 0.00 0.47 0.00 16.25 03:59:01 AM 0.13 0.00 0.13 0.00 9.73 04:00:01 AM 0.23 0.00 0.23 0.00 16.09 04:01:01 AM 0.35 0.00 0.35 0.00 27.37 04:02:01 AM 0.22 0.00 0.22 0.00 6.41 04:03:01 AM 0.12 0.00 0.12 0.00 1.17 04:04:01 AM 0.13 0.00 0.13 0.00 3.37 04:05:01 AM 0.22 0.00 0.22 0.00 3.02 04:06:01 AM 0.25 0.00 0.25 0.00 3.93 04:07:01 AM 0.13 0.00 0.13 0.00 3.62 04:08:01 AM 0.27 0.00 0.27 0.00 3.23 04:09:01 AM 0.23 0.00 0.23 0.00 8.06 04:10:01 AM 0.25 0.00 0.25 0.00 10.46 04:11:01 AM 0.45 0.00 0.45 0.00 7.06 04:12:01 AM 0.27 0.00 0.27 0.00 4.10 04:13:01 AM 0.15 0.00 0.15 0.00 3.73 04:14:01 AM 0.13 0.00 0.13 0.00 5.20 04:15:01 AM 0.32 0.00 0.32 0.00 5.37 04:16:01 AM 0.27 0.00 0.27 0.00 8.83 04:17:01 AM 0.10 0.00 0.10 0.00 1.18 04:18:01 AM 0.17 0.00 0.17 0.00 6.15 04:19:01 AM 0.13 0.00 0.13 0.00 9.62 04:20:01 AM 0.18 0.00 0.18 0.00 13.81 04:21:01 AM 0.35 0.00 0.35 0.00 18.93 04:22:01 AM 0.32 0.00 0.32 0.00 20.09 04:23:01 AM 0.18 0.00 0.18 0.00 9.90 04:24:01 AM 0.15 0.00 0.15 0.00 14.80 04:25:01 AM 0.25 0.00 0.25 0.00 23.20 04:26:01 AM 0.25 0.00 0.25 0.00 7.05 04:27:01 AM 0.13 0.00 0.13 0.00 2.12 04:28:01 AM 0.13 0.00 0.13 0.00 3.62 04:29:01 AM 0.15 0.00 0.15 0.00 1.47 04:30:01 AM 0.17 0.00 0.17 0.00 1.98 04:31:01 AM 0.38 0.00 0.38 0.00 8.96 04:32:01 AM 0.23 0.00 0.23 0.00 2.93 04:33:01 AM 0.13 0.00 0.13 0.00 8.80 04:34:01 AM 0.12 0.00 0.12 0.00 5.88 04:35:01 AM 0.18 0.00 0.18 0.00 2.07 04:36:01 AM 0.27 0.00 0.27 0.00 6.18 04:37:01 AM 0.27 0.00 0.27 0.00 3.25 04:38:01 AM 0.17 0.00 0.17 0.00 3.22 04:39:01 AM 0.25 0.00 0.25 0.00 7.78 04:40:01 AM 0.23 0.00 0.23 0.00 2.52 04:41:01 AM 0.33 0.00 0.33 0.00 10.43 04:42:01 AM 0.18 0.00 0.18 0.00 16.53 04:43:01 AM 0.13 0.00 0.13 0.00 13.20 04:44:01 AM 0.12 0.00 0.12 0.00 8.40 04:45:01 AM 0.22 0.00 0.22 0.00 17.08 04:46:01 AM 0.72 0.00 0.72 0.00 21.16 04:47:01 AM 0.40 0.00 0.40 0.00 16.38 04:48:01 AM 0.28 0.00 0.28 0.00 19.73 04:49:01 AM 0.33 0.00 0.33 0.00 4.77 04:50:01 AM 0.38 0.00 0.38 0.00 3.60 04:51:02 AM 0.38 0.00 0.38 0.00 9.36 04:52:01 AM 0.14 0.00 0.14 0.00 1.36 04:53:01 AM 0.27 0.00 0.27 0.00 5.85 04:54:01 AM 0.22 0.00 0.22 0.00 2.57 04:55:01 AM 0.15 0.00 0.15 0.00 1.02 04:56:01 AM 0.25 0.00 0.25 0.00 16.39 04:57:01 AM 0.27 0.00 0.27 0.00 8.12 04:58:01 AM 0.15 0.00 0.15 0.00 8.53 04:59:01 AM 0.20 0.00 0.20 0.00 8.52 05:00:01 AM 0.22 0.00 0.22 0.00 10.35 05:01:01 AM 0.97 0.00 0.97 0.00 32.06 05:02:01 AM 0.57 0.00 0.57 0.00 9.00 05:03:01 AM 19.64 0.25 19.39 37.19 3323.54 Average: 0.40 0.04 0.36 0.73 43.36 12:00:00 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:00:01 AM 4806868 6952532 3075568 39.02 2688 2314904 818904 9.17 308048 2391788 43456 12:01:01 AM 4765528 7009756 3116908 39.54 2688 2413320 719312 8.05 382736 2359272 32980 12:02:01 AM 4765992 7010648 3116444 39.54 2688 2413748 719312 8.05 382804 2359392 56 12:03:01 AM 4764384 7009624 3118052 39.56 2688 2414324 719312 8.05 382804 2361212 4 12:04:01 AM 4763328 7008652 3119108 39.57 2688 2414408 719312 8.05 382804 2362240 4 12:05:01 AM 4763132 7008460 3119304 39.57 2688 2414412 719312 8.05 382804 2362444 16 12:06:01 AM 4763240 7008628 3119196 39.57 2688 2414492 719312 8.05 382804 2362408 8 12:07:01 AM 4762824 7008212 3119612 39.58 2688 2414492 718244 8.04 382804 2362688 4 12:08:01 AM 4763040 7008856 3119396 39.57 2688 2414916 719752 8.06 382888 2362684 84 12:09:01 AM 4762948 7008764 3119488 39.58 2688 2414916 719752 8.06 382888 2362808 8 12:10:01 AM 4762236 7008188 3120200 39.58 2688 2415052 716564 8.02 382888 2362956 144 12:11:01 AM 4762540 7008576 3119896 39.58 2688 2415136 716564 8.02 382888 2363132 56 12:12:01 AM 4762540 7008648 3119896 39.58 2688 2415208 716564 8.02 382888 2363024 4 12:13:01 AM 4762628 7008740 3119808 39.58 2688 2415212 716564 8.02 382888 2363028 4 12:14:01 AM 4762632 7008760 3119804 39.58 2688 2415228 716564 8.02 382888 2363040 24 12:15:01 AM 4762660 7008796 3119776 39.58 2688 2415236 716564 8.02 382888 2363052 16 12:16:01 AM 4762412 7008600 3120024 39.58 2688 2415288 716564 8.02 382888 2363172 56 12:17:01 AM 4762212 7008748 3120224 39.58 2688 2415636 716564 8.02 382888 2363464 104 12:18:01 AM 4761780 7008668 3120656 39.59 2688 2415996 716564 8.02 382888 2363816 40 12:19:01 AM 4761376 7008584 3121060 39.60 2688 2416308 716564 8.02 382888 2364136 164 12:20:01 AM 4760884 7008448 3121552 39.60 2688 2416672 720728 8.07 382888 2364608 136 12:21:01 AM 4760852 7008784 3121584 39.60 2688 2417040 720728 8.07 382888 2364928 4 12:22:01 AM 4760472 7008760 3121964 39.61 2688 2417388 720728 8.07 382888 2365216 156 12:23:02 AM 4760160 7008648 3122276 39.61 2688 2417588 720728 8.07 383000 2365304 4 12:24:01 AM 4760112 7008652 3122324 39.61 2688 2417640 720728 8.07 383000 2365356 4 12:25:01 AM 4760112 7008660 3122324 39.61 2688 2417648 720728 8.07 383000 2365364 4 12:26:01 AM 4759696 7008444 3122740 39.62 2688 2417848 720728 8.07 383000 2365616 4 12:27:01 AM 4759036 7008080 3123400 39.62 2688 2418144 720728 8.07 383000 2366396 4 12:28:01 AM 4757572 7006976 3124864 39.64 2688 2418504 720728 8.07 383000 2367776 160 12:29:01 AM 4757416 7007172 3125020 39.65 2688 2418856 720728 8.07 383004 2367988 152 12:30:01 AM 4756784 7006888 3125652 39.65 2688 2419212 710384 7.95 383000 2368476 24 12:31:01 AM 4756868 7007324 3125568 39.65 2688 2419560 710384 7.95 383000 2368784 112 12:32:01 AM 4756052 7006868 3126384 39.66 2688 2419912 710384 7.95 383000 2369220 76 12:33:01 AM 4755548 7006980 3126888 39.67 2688 2420536 710384 7.95 383000 2369892 144 12:34:01 AM 4755432 7006960 3127004 39.67 2688 2420624 710384 7.95 383000 2370128 16 12:35:01 AM 4755432 7006960 3127004 39.67 2688 2420624 725888 8.13 383000 2370188 8 12:36:01 AM 4755368 7006976 3127068 39.67 2688 2420704 725888 8.13 383000 2370020 92 12:37:01 AM 4755428 7007036 3127008 39.67 2688 2420704 725888 8.13 383000 2370068 4 12:38:01 AM 4755472 7007160 3126964 39.67 2688 2420784 725888 8.13 383000 2370032 88 12:39:01 AM 4755272 7006964 3127164 39.67 2688 2420788 725888 8.13 383000 2370036 4 12:40:01 AM 4755536 7007268 3126900 39.67 2688 2420828 718596 8.05 383000 2369960 48 12:41:01 AM 4755192 7007068 3127244 39.67 2688 2420972 718596 8.05 383000 2370304 24 12:42:01 AM 4754616 7006596 3127820 39.68 2688 2421076 718596 8.05 383000 2370616 4 12:43:01 AM 4754576 7006556 3127860 39.68 2688 2421076 718596 8.05 383000 2370732 4 12:44:01 AM 4754524 7006556 3127912 39.68 2688 2421128 718596 8.05 383000 2370664 56 12:45:01 AM 4754468 7006772 3127968 39.68 2688 2421400 718596 8.05 383000 2370928 28 12:46:01 AM 4754428 7007072 3128008 39.68 2688 2421740 718596 8.05 383000 2371084 36 12:47:01 AM 4753716 7006708 3128720 39.69 2688 2422088 718596 8.05 383000 2371568 24 12:48:01 AM 4753624 7006976 3128812 39.69 2688 2422448 718596 8.05 383000 2371736 4 12:49:01 AM 4753512 7007204 3128924 39.69 2688 2422788 718596 8.05 383000 2372076 4 12:50:01 AM 4752500 7006744 3129936 39.71 2688 2423340 718620 8.05 383120 2372644 32 12:51:01 AM 4752356 7006892 3130080 39.71 2688 2423632 718620 8.05 383120 2372888 32 12:52:01 AM 4752440 7007084 3129996 39.71 2688 2423740 718620 8.05 383120 2372928 104 12:53:01 AM 4752144 7007056 3130292 39.71 2688 2424008 718620 8.05 383120 2373180 56 12:54:01 AM 4751712 7006960 3130724 39.72 2688 2424352 718620 8.05 383120 2373548 56 12:55:01 AM 4751456 7007064 3130980 39.72 2688 2424704 718620 8.05 383120 2373992 188 12:56:01 AM 4750924 7006892 3131512 39.73 2688 2425064 734000 8.22 383120 2374512 104 12:57:01 AM 4750352 7006672 3132084 39.73 2688 2425416 734000 8.22 383120 2374916 64 12:58:01 AM 4749908 7006548 3132528 39.74 2688 2425736 734000 8.22 383120 2375388 188 12:59:01 AM 4750208 7007036 3132228 39.74 2688 2425924 734000 8.22 383120 2375256 24 01:00:01 AM 4748564 7005632 3133872 39.76 2688 2426164 733664 8.21 383120 2376308 4 01:01:01 AM 4748176 7005648 3134260 39.76 2688 2426568 733664 8.21 383124 2376700 32 01:02:01 AM 4748676 7006456 3133760 39.76 2688 2426884 733664 8.21 383128 2376528 24 01:03:01 AM 4748768 7006896 3133668 39.76 2688 2427232 733664 8.21 383128 2376612 24 01:04:01 AM 4748048 7006516 3134388 39.76 2688 2427564 733664 8.21 383128 2377088 4 01:05:01 AM 4747576 7006372 3134860 39.77 2688 2427900 733664 8.21 383128 2377500 56 01:06:01 AM 4747592 7006748 3134844 39.77 2688 2428252 733664 8.21 383128 2377756 192 01:07:01 AM 4746916 7006652 3135520 39.78 2688 2428832 717116 8.03 383128 2378432 92 01:08:01 AM 4746728 7006464 3135708 39.78 2688 2428832 717116 8.03 383128 2378632 8 01:09:01 AM 4746624 7006368 3135812 39.78 2688 2428840 717116 8.03 383128 2378580 20 01:10:01 AM 4746632 7006452 3135804 39.78 2688 2428916 710508 7.96 383156 2378544 4 01:11:01 AM 4746840 7006660 3135596 39.78 2688 2428916 710508 7.96 383156 2378616 4 01:12:01 AM 4746688 7006588 3135748 39.78 2688 2428996 710508 7.96 383156 2378512 4 01:13:01 AM 4746844 7006744 3135592 39.78 2688 2428996 710508 7.96 383156 2378512 4 01:14:01 AM 4746388 7006456 3136048 39.79 2688 2429164 710508 7.96 383156 2378896 4 01:15:01 AM 4746404 7006532 3136032 39.79 2688 2429224 729152 8.16 383156 2378760 20 01:16:01 AM 4746360 7006548 3136076 39.79 2688 2429284 729152 8.16 383156 2378888 12 01:17:01 AM 4746288 7006476 3136148 39.79 2688 2429284 729152 8.16 383156 2378936 8 01:18:01 AM 4746336 7006728 3136100 39.79 2688 2429488 729152 8.16 383156 2379024 144 01:19:01 AM 4745908 7006640 3136528 39.79 2688 2429828 729152 8.16 383156 2379372 36 01:20:01 AM 4745296 7006380 3137140 39.80 2688 2430188 729152 8.16 383156 2379840 208 01:21:01 AM 4745064 7006516 3137372 39.80 2688 2430552 729152 8.16 383156 2380164 176 01:22:01 AM 4744820 7006596 3137616 39.81 2688 2430876 729152 8.16 383156 2380536 40 01:23:01 AM 4744344 7006484 3138092 39.81 2688 2431232 729152 8.16 383156 2380920 24 01:24:01 AM 4743932 7006444 3138504 39.82 2688 2431604 729152 8.16 383156 2381372 36 01:25:01 AM 4743604 7006252 3138832 39.82 2688 2431740 708296 7.93 383156 2381544 24 01:26:01 AM 4743340 7006224 3139096 39.82 2688 2431976 723968 8.11 383156 2381764 80 01:27:01 AM 4743244 7006488 3139192 39.83 2688 2432344 723968 8.11 383156 2381936 176 01:28:01 AM 4742404 7005988 3140032 39.84 2688 2432684 723968 8.11 383156 2382732 48 01:29:01 AM 4743148 7007104 3139288 39.83 2688 2433048 723968 8.11 383152 2382368 4 01:30:01 AM 4742708 7007012 3139728 39.83 2688 2433396 718232 8.04 383152 2382716 116 01:31:02 AM 4742260 7006904 3140176 39.84 2688 2433744 718232 8.04 383152 2383124 48 01:32:01 AM 4741692 7006696 3140744 39.84 2688 2434104 718232 8.04 383152 2383668 172 01:33:01 AM 4741152 7006724 3141284 39.85 2688 2434664 718232 8.04 383152 2384132 96 01:34:01 AM 4741404 7006984 3141032 39.85 2688 2434672 718232 8.04 383152 2384004 4 01:35:01 AM 4741356 7006936 3141080 39.85 2688 2434672 718232 8.04 383152 2384004 4 01:36:01 AM 4741244 7006900 3141192 39.85 2688 2434748 718232 8.04 383152 2384148 8 01:37:01 AM 4741348 7007008 3141088 39.85 2688 2434752 718232 8.04 383152 2384084 4 01:38:01 AM 4741244 7006984 3141192 39.85 2688 2434832 718232 8.04 383152 2384164 4 01:39:01 AM 4741312 7007052 3141124 39.85 2688 2434832 718232 8.04 383152 2384164 4 01:40:01 AM 4740400 7006312 3142036 39.86 2688 2435004 733636 8.21 383152 2384688 176 01:41:01 AM 4740768 7006740 3141668 39.86 2688 2435060 733636 8.21 383152 2384592 24 01:42:01 AM 4740952 7006984 3141484 39.85 2688 2435120 733636 8.21 383152 2384468 8 01:43:01 AM 4740616 7006652 3141820 39.86 2688 2435124 733636 8.21 383152 2384472 4 01:44:01 AM 4740744 7006852 3141692 39.86 2688 2435196 733636 8.21 383152 2384552 4 01:45:01 AM 4740804 7006912 3141632 39.86 2688 2435196 733636 8.21 383152 2384544 4 01:46:01 AM 4740592 7006780 3141844 39.86 2688 2435276 733636 8.21 383152 2384692 4 01:47:01 AM 4740620 7006808 3141816 39.86 2688 2435276 717148 8.03 383152 2384828 4 01:48:01 AM 4740644 7006920 3141792 39.86 2688 2435356 724940 8.12 392744 2375128 240 01:49:01 AM 4740724 7007004 3141712 39.86 2688 2435360 724940 8.12 392744 2375132 4 01:50:01 AM 4740448 7006816 3141988 39.86 2688 2435448 718280 8.04 392744 2375340 96 01:51:01 AM 4740352 7006724 3142084 39.86 2688 2435452 718280 8.04 392744 2375296 4 01:52:01 AM 4740192 7006640 3142244 39.86 2688 2435528 718280 8.04 392744 2375304 84 01:53:01 AM 4740300 7006748 3142136 39.86 2688 2435528 718280 8.04 392744 2375304 4 01:54:01 AM 4740148 7006680 3142288 39.86 2688 2435612 718280 8.04 392744 2375504 88 01:55:01 AM 4740260 7006792 3142176 39.86 2688 2435612 718280 8.04 392744 2375388 4 01:56:01 AM 4740244 7006852 3142192 39.86 2688 2435688 718280 8.04 392752 2375516 84 01:57:01 AM 4739956 7006856 3142480 39.87 2688 2435980 718280 8.04 392752 2375920 32 01:58:01 AM 4739516 7006760 3142920 39.87 2688 2436324 718280 8.04 392752 2376264 176 01:59:01 AM 4739176 7006768 3143260 39.88 2688 2436680 718280 8.04 392752 2376728 168 02:00:01 AM 4738732 7006688 3143704 39.88 2688 2437036 718364 8.04 392752 2377092 64 02:01:01 AM 4738212 7006532 3144224 39.89 2688 2437404 718364 8.04 392760 2377420 212 02:02:01 AM 4737988 7006664 3144448 39.89 2688 2437760 718364 8.04 392768 2377944 124 02:03:01 AM 4737404 7006360 3145032 39.90 2688 2438040 718364 8.04 392768 2378176 24 02:04:01 AM 4737496 7006560 3144940 39.90 2688 2438148 718364 8.04 392768 2378232 112 02:05:01 AM 4737320 7006388 3145116 39.90 2688 2438152 718364 8.04 392768 2378304 4 02:06:01 AM 4737392 7006556 3145044 39.90 2688 2438248 718364 8.04 392768 2378400 4 02:07:01 AM 4737588 7006752 3144848 39.90 2688 2438248 718364 8.04 392768 2378168 4 02:08:01 AM 4737536 7006796 3144900 39.90 2688 2438344 718364 8.04 392768 2378296 100 02:09:01 AM 4737592 7006852 3144844 39.90 2688 2438344 733740 8.22 392768 2378296 4 02:10:01 AM 4736976 7006328 3145460 39.90 2688 2438436 727868 8.15 392768 2378720 100 02:11:01 AM 4737052 7006408 3145384 39.90 2688 2438440 727868 8.15 392768 2378744 4 02:12:01 AM 4736192 7005640 3146244 39.91 2688 2438532 727868 8.15 392768 2379576 100 02:13:01 AM 4736016 7005468 3146420 39.92 2688 2438536 727868 8.15 392768 2379532 4 02:14:01 AM 4736020 7005472 3146416 39.92 2688 2438536 727868 8.15 392768 2379536 4 02:15:01 AM 4735444 7004992 3146992 39.92 2688 2438632 727868 8.15 392768 2380248 4 02:16:01 AM 4735364 7004916 3147072 39.93 2688 2438636 727868 8.15 392768 2380320 4 02:17:01 AM 4733556 7003336 3148880 39.95 2688 2438864 727868 8.15 392768 2382072 128 02:18:01 AM 4732872 7003012 3149564 39.96 2688 2439224 727868 8.15 392768 2382996 8 02:19:01 AM 4732080 7002536 3150356 39.97 2688 2439540 727868 8.15 392768 2383580 120 02:20:01 AM 4731800 7002604 3150636 39.97 2688 2439896 745356 8.35 392768 2383928 80 02:21:01 AM 4731372 7002540 3151064 39.98 2688 2440248 745356 8.35 392768 2384360 16 02:22:01 AM 4731048 7002576 3151388 39.98 2688 2440608 745356 8.35 392768 2384652 188 02:23:01 AM 4730136 7002048 3152300 39.99 2688 2440992 745356 8.35 392768 2385564 152 02:24:01 AM 4729788 7001808 3152648 40.00 2688 2441100 745356 8.35 392768 2385848 16 02:25:01 AM 4730068 7002092 3152368 39.99 2688 2441104 745356 8.35 392768 2385668 12 02:26:01 AM 4729796 7001916 3152640 40.00 2688 2441200 745356 8.35 392768 2385772 104 02:27:01 AM 4729960 7002080 3152476 39.99 2688 2441200 745356 8.35 392768 2385704 4 02:28:01 AM 4729796 7002012 3152640 40.00 2688 2441296 745356 8.35 392768 2385800 100 02:29:01 AM 4730024 7002240 3152412 39.99 2688 2441296 745356 8.35 392768 2385920 4 02:30:01 AM 4729340 7001648 3153096 40.00 2688 2441388 740040 8.29 392768 2386268 100 02:31:01 AM 4729484 7001800 3152952 40.00 2688 2441396 740040 8.29 392768 2386028 4 02:32:01 AM 4729444 7001852 3152992 40.00 2688 2441488 740040 8.29 392768 2386308 4 02:33:01 AM 4729284 7001696 3153152 40.00 2688 2441492 740040 8.29 392768 2386336 16 02:34:01 AM 4729360 7001772 3153076 40.00 2688 2441492 740040 8.29 392768 2386288 8 02:35:01 AM 4729492 7001996 3152944 40.00 2688 2441584 740040 8.29 392768 2386184 8 02:36:01 AM 4729596 7002104 3152840 40.00 2688 2441588 740040 8.29 392768 2386372 4 02:37:01 AM 4729380 7002124 3153056 40.00 2688 2441832 740040 8.29 392768 2386436 64 02:38:02 AM 4728892 7001996 3153544 40.01 2688 2442192 740040 8.29 392768 2386840 184 02:39:01 AM 4728476 7001904 3153960 40.01 2688 2442508 740040 8.29 392768 2387280 64 02:40:01 AM 4728004 7001784 3154432 40.02 2688 2442864 730556 8.18 392768 2387752 224 02:41:01 AM 4727880 7002008 3154556 40.02 2688 2443204 730556 8.18 392768 2387932 136 02:42:01 AM 4727312 7001800 3155124 40.03 2688 2443564 730556 8.18 392768 2388192 104 02:43:01 AM 4727136 7001988 3155300 40.03 2688 2443928 730556 8.18 392768 2388588 4 02:44:01 AM 4726896 7001864 3155540 40.03 2688 2444044 730556 8.18 392768 2388848 4 02:45:01 AM 4726852 7001820 3155584 40.03 2688 2444044 730556 8.18 392768 2389032 4 02:46:01 AM 4726632 7001696 3155804 40.04 2688 2444140 730556 8.18 392768 2389020 104 02:47:01 AM 4726484 7001552 3155952 40.04 2688 2444144 730556 8.18 392768 2389096 16 02:48:01 AM 4726520 7001680 3155916 40.04 2688 2444236 730556 8.18 392768 2389188 100 02:49:01 AM 4726756 7001916 3155680 40.03 2688 2444236 730556 8.18 392768 2389056 16 02:50:01 AM 4726284 7001540 3156152 40.04 2688 2444332 730616 8.18 392768 2389336 100 02:51:01 AM 4726796 7002056 3155640 40.03 2688 2444332 730616 8.18 392768 2389088 12 02:52:01 AM 4726544 7001900 3155892 40.04 2688 2444428 730616 8.18 392768 2389116 104 02:53:01 AM 4726624 7001980 3155812 40.04 2688 2444428 730616 8.18 392768 2389116 4 02:54:01 AM 4726296 7001744 3156140 40.04 2688 2444520 730616 8.18 392768 2389316 100 02:55:01 AM 4726432 7001884 3156004 40.04 2688 2444524 730616 8.18 392768 2389500 8 02:56:01 AM 4726352 7001804 3156084 40.04 2688 2444524 730616 8.18 392768 2389480 4 02:57:01 AM 4726108 7001812 3156328 40.04 2688 2444776 730616 8.18 392768 2389792 24 02:58:01 AM 4725908 7002004 3156528 40.05 2688 2445168 730616 8.18 392768 2389932 48 02:59:01 AM 4725368 7001812 3157068 40.05 2688 2445516 730616 8.18 392768 2390280 24 03:00:01 AM 4724944 7001740 3157492 40.06 2688 2445868 722428 8.09 392768 2390752 128 03:01:01 AM 4723700 7000844 3158736 40.07 2688 2446220 722428 8.09 392768 2391508 40 03:02:01 AM 4724444 7001948 3157992 40.06 2688 2446572 722428 8.09 392772 2391332 64 03:03:01 AM 4723456 7001312 3158980 40.08 2688 2446932 722428 8.09 392772 2392164 176 03:04:01 AM 4723420 7001808 3159016 40.08 2688 2447456 722428 8.09 392772 2392240 40 03:05:01 AM 4723312 7001768 3159124 40.08 2688 2447524 722428 8.09 392772 2392316 4 03:06:01 AM 4723500 7001956 3158936 40.08 2688 2447524 722428 8.09 392772 2392384 4 03:07:01 AM 4723628 7002168 3158808 40.07 2688 2447608 722428 8.09 392772 2392384 4 03:08:01 AM 4723364 7001904 3159072 40.08 2688 2447608 722428 8.09 392772 2392516 4 03:09:01 AM 4723012 7001628 3159424 40.08 2688 2447684 722428 8.09 392772 2392576 4 03:10:01 AM 4722912 7001532 3159524 40.08 2688 2447688 742936 8.32 392772 2392596 4 03:11:01 AM 4723080 7001868 3159356 40.08 2688 2447856 742936 8.32 392772 2392720 176 03:12:01 AM 4588656 6876836 3293780 41.79 2688 2457284 881052 9.87 392760 2524392 13688 03:13:01 AM 4721724 7000692 3160712 40.10 2688 2448016 724536 8.11 397608 2388092 4 03:14:01 AM 4721612 7000580 3160824 40.10 2688 2448016 724536 8.11 397600 2387992 4 03:15:01 AM 4721900 7000952 3160536 40.10 2688 2448100 724536 8.11 397600 2388188 24 03:16:01 AM 4722004 7001456 3160432 40.09 2688 2448508 724536 8.11 397600 2388532 96 03:17:01 AM 4721988 7001796 3160448 40.09 2688 2448864 724536 8.11 397600 2388820 88 03:18:01 AM 4721764 7001936 3160672 40.10 2688 2449220 724536 8.11 397600 2389184 24 03:19:01 AM 4721336 7001852 3161100 40.10 2688 2449564 724536 8.11 397600 2389528 32 03:20:01 AM 4720772 7001636 3161664 40.11 2688 2449920 730684 8.18 397600 2390108 24 03:21:01 AM 4720428 7001656 3162008 40.11 2688 2450276 730684 8.18 397600 2390324 48 03:22:01 AM 4720448 7001804 3161988 40.11 2688 2450404 730684 8.18 397600 2390500 4 03:23:01 AM 4720276 7001856 3162160 40.12 2688 2450628 730684 8.18 397600 2390644 144 03:24:01 AM 4719960 7001892 3162476 40.12 2688 2450988 730684 8.18 397600 2390996 144 03:25:01 AM 4719432 7001724 3163004 40.13 2688 2451340 730684 8.18 397600 2391356 136 03:26:01 AM 4718940 7001560 3163496 40.13 2688 2451668 730684 8.18 397600 2391868 64 03:27:01 AM 4718704 7001684 3163732 40.14 2688 2452028 730684 8.18 397600 2392044 212 03:28:01 AM 4718564 7001880 3163872 40.14 2688 2452372 730684 8.18 397600 2392384 104 03:29:01 AM 4718140 7001848 3164296 40.14 2688 2452756 730684 8.18 397600 2392776 80 03:30:01 AM 4717796 7001752 3164640 40.15 2688 2453004 722492 8.09 397600 2393124 240 03:31:01 AM 4717672 7001860 3164764 40.15 2688 2453236 722492 8.09 397600 2393312 84 03:32:01 AM 4717104 7001644 3165332 40.16 2688 2453596 722492 8.09 397600 2393848 88 03:33:01 AM 4716656 7001556 3165780 40.16 2688 2453956 722492 8.09 397600 2394168 80 03:34:01 AM 4716296 7001552 3166140 40.17 2688 2454304 722492 8.09 397600 2394436 188 03:35:01 AM 4715976 7001572 3166460 40.17 2688 2454652 722492 8.09 397600 2394772 136 03:36:01 AM 4715596 7001564 3166840 40.18 2688 2455012 722492 8.09 397600 2395124 72 03:37:01 AM 4715032 7001668 3167404 40.18 2688 2455680 722492 8.09 397600 2395840 28 03:38:01 AM 4715020 7001764 3167416 40.18 2688 2455788 722492 8.09 397600 2395836 4 03:39:01 AM 4715068 7001816 3167368 40.18 2688 2455792 722492 8.09 397600 2395840 4 03:40:01 AM 4714488 7001312 3167948 40.19 2688 2455868 740960 8.30 397600 2396380 84 03:41:01 AM 4714948 7001776 3167488 40.18 2688 2455872 721496 8.08 397600 2395988 4 03:42:01 AM 4714716 7001552 3167720 40.19 2688 2455880 721496 8.08 397600 2395924 16 03:43:01 AM 4714876 7001788 3167560 40.19 2688 2455956 721496 8.08 397600 2396004 8 03:44:01 AM 4714904 7001816 3167532 40.18 2688 2455956 721496 8.08 397600 2396004 4 03:45:01 AM 4714580 7001676 3167856 40.19 2688 2456140 721496 8.08 397600 2396200 24 03:46:01 AM 4714240 7001520 3168196 40.19 2688 2456324 721496 8.08 397608 2396444 12 03:47:01 AM 4713964 7001244 3168472 40.20 2688 2456324 721496 8.08 397608 2396584 4 03:48:01 AM 4714124 7001444 3168312 40.19 2688 2456364 721496 8.08 397608 2396536 48 03:49:01 AM 4714284 7001672 3168152 40.19 2688 2456432 721496 8.08 397608 2396604 56 03:50:01 AM 4713880 7001364 3168556 40.20 2688 2456528 744536 8.34 397608 2396816 48 03:51:01 AM 4714036 7001588 3168400 40.20 2688 2456596 744536 8.34 397608 2396752 56 03:52:01 AM 4713820 7001512 3168616 40.20 2688 2456736 744536 8.34 397612 2396804 4 03:53:01 AM 4713792 7001484 3168644 40.20 2688 2456736 744536 8.34 397612 2396920 4 03:54:01 AM 4713764 7001600 3168672 40.20 2688 2456880 726520 8.13 397612 2396948 4 03:55:01 AM 4713328 7001500 3169108 40.20 2688 2457216 726520 8.13 397612 2397420 32 03:56:01 AM 4713196 7001720 3169240 40.21 2688 2457576 726520 8.13 397612 2397728 24 03:57:01 AM 4712940 7001824 3169496 40.21 2688 2457928 726520 8.13 397612 2398024 16 03:58:01 AM 4711944 7001172 3170492 40.22 2688 2458272 726520 8.13 397612 2398580 16 03:59:01 AM 4712048 7001624 3170388 40.22 2688 2458628 726520 8.13 397612 2398724 112 04:00:01 AM 4711512 7001452 3170924 40.23 2688 2458992 743872 8.33 397612 2399204 80 04:01:01 AM 4709692 7000236 3172744 40.25 2688 2459596 743872 8.33 397612 2400688 24 04:02:01 AM 4711104 7001748 3171332 40.23 2688 2459688 727012 8.14 397616 2399792 4 04:03:01 AM 4711128 7001772 3171308 40.23 2688 2459688 727012 8.14 397616 2399792 4 04:04:01 AM 4710824 7001544 3171612 40.24 2688 2459764 727012 8.14 397616 2399872 4 04:05:01 AM 4710868 7001592 3171568 40.24 2688 2459768 727012 8.14 397616 2399876 4 04:06:01 AM 4710844 7001648 3171592 40.24 2688 2459848 727012 8.14 397616 2400024 88 04:07:01 AM 4710756 7001560 3171680 40.24 2688 2459848 727012 8.14 397616 2399960 4 04:08:01 AM 4710824 7001768 3171612 40.24 2688 2459988 727012 8.14 397616 2400088 144 04:09:01 AM 4710600 7001624 3171836 40.24 2688 2460068 727012 8.14 397616 2400180 56 04:10:01 AM 4709964 7001136 3172472 40.25 2688 2460216 743292 8.32 397616 2400676 4 04:11:01 AM 4710432 7001608 3172004 40.24 2688 2460220 743292 8.32 397616 2400400 4 04:12:01 AM 4710276 7001500 3172160 40.24 2688 2460268 743292 8.32 397620 2400472 16 04:13:01 AM 4710280 7001624 3172156 40.24 2688 2460388 743292 8.32 397624 2400496 56 04:14:01 AM 4709880 7001300 3172556 40.25 2688 2460464 743292 8.32 397624 2400792 16 04:15:01 AM 4710032 7001620 3172404 40.25 2688 2460648 727132 8.14 397624 2400792 152 04:16:01 AM 4709732 7001336 3172704 40.25 2688 2460648 727132 8.14 397624 2400912 4 04:17:01 AM 4709664 7001272 3172772 40.25 2688 2460652 727132 8.14 397624 2401152 4 04:18:01 AM 4709712 7001528 3172724 40.25 2688 2460860 727132 8.14 397624 2401028 72 04:19:01 AM 4709340 7001532 3173096 40.26 2688 2461236 727132 8.14 397624 2401392 184 04:20:01 AM 4708828 7001344 3173608 40.26 2688 2461568 722556 8.09 397624 2401832 144 04:21:01 AM 4708564 7001440 3173872 40.27 2688 2461924 722556 8.09 397624 2402140 124 04:22:01 AM 4708104 7001328 3174332 40.27 2688 2462264 722556 8.09 397624 2402604 4 04:23:01 AM 4707876 7001452 3174560 40.27 2688 2462624 722556 8.09 397624 2402920 152 04:24:01 AM 4707680 7001612 3174756 40.28 2688 2462972 722556 8.09 397624 2403152 88 04:25:01 AM 4707136 7001584 3175300 40.28 2688 2463488 722556 8.09 397624 2403692 4 04:26:01 AM 4706812 7001332 3175624 40.29 2688 2463560 737968 8.26 397624 2403832 16 04:27:01 AM 4707052 7001572 3175384 40.28 2688 2463560 737968 8.26 397624 2403764 8 04:28:01 AM 4707000 7001600 3175436 40.28 2688 2463640 737968 8.26 397624 2403844 4 04:29:01 AM 4706972 7001572 3175464 40.29 2688 2463640 737968 8.26 397624 2403960 4 04:30:01 AM 4706356 7001036 3176080 40.29 2688 2463720 730760 8.18 397624 2404156 88 04:31:01 AM 4706728 7001420 3175708 40.29 2688 2463728 730760 8.18 397624 2404004 4 04:32:01 AM 4706400 7001260 3176036 40.29 2688 2463896 730760 8.18 397624 2404228 188 04:33:01 AM 4706276 7001196 3176160 40.29 2688 2463956 730760 8.18 397624 2404308 16 04:34:01 AM 4706008 7001064 3176428 40.30 2688 2464092 730760 8.18 397628 2404508 4 04:35:01 AM 4706272 7001328 3176164 40.29 2688 2464092 730760 8.18 397628 2404296 4 04:36:01 AM 4706180 7001296 3176256 40.30 2688 2464152 730760 8.18 397628 2404544 8 04:37:01 AM 4706336 7001452 3176100 40.29 2688 2464152 730760 8.18 397628 2404360 4 04:38:01 AM 4706236 7001540 3176200 40.29 2688 2464340 730760 8.18 397632 2404544 144 04:39:01 AM 4706076 7001384 3176360 40.30 2688 2464344 730760 8.18 397632 2404548 4 04:40:01 AM 4705308 7000720 3177128 40.31 2688 2464448 746152 8.35 397632 2405000 112 04:41:01 AM 4705608 7001196 3176828 40.30 2688 2464624 723088 8.10 397632 2405028 104 04:42:01 AM 4705536 7001476 3176900 40.30 2688 2464984 723088 8.10 397632 2405196 32 04:43:01 AM 4705172 7001472 3177264 40.31 2688 2465344 723088 8.10 397632 2405556 24 04:44:01 AM 4704664 7001308 3177772 40.31 2688 2465680 723088 8.10 397632 2406096 144 04:45:01 AM 4704232 7001220 3178204 40.32 2688 2466024 723088 8.10 397632 2406520 32 04:46:01 AM 4704176 7001512 3178260 40.32 2688 2466380 723088 8.10 397632 2406664 24 04:47:01 AM 4703516 7001240 3178920 40.33 2688 2466768 723088 8.10 397632 2407316 48 04:48:01 AM 4703024 7001276 3179412 40.34 2688 2467288 723088 8.10 397632 2407520 40 04:49:01 AM 4703196 7001448 3179240 40.33 2688 2467288 723088 8.10 397632 2407524 4 04:50:01 AM 4702964 7001216 3179472 40.34 2688 2467288 735492 8.24 397632 2407640 4 04:51:02 AM 4703148 7001472 3179288 40.33 2688 2467372 735492 8.24 397632 2407676 4 04:52:01 AM 4703196 7001520 3179240 40.33 2688 2467372 735492 8.24 397632 2407724 4 04:53:01 AM 4703108 7001512 3179328 40.33 2688 2467452 735492 8.24 397632 2407824 12 04:54:01 AM 4702916 7001320 3179520 40.34 2688 2467452 735492 8.24 397632 2407824 4 04:55:01 AM 4702672 7001244 3179764 40.34 2688 2467620 735492 8.24 397632 2407844 176 04:56:01 AM 4702292 7001060 3180144 40.34 2688 2467816 735492 8.24 397632 2408284 4 04:57:01 AM 4699860 6998824 3182576 40.38 2688 2468004 753224 8.43 397636 2410548 48 04:58:01 AM 4699168 6998316 3183268 40.38 2688 2468188 788656 8.83 397636 2411112 4 04:59:01 AM 4696352 6995688 3186084 40.42 2688 2468376 821480 9.20 397636 2413424 4 05:00:01 AM 4693568 6993428 3188868 40.46 2688 2468892 897396 10.05 397636 2415692 312 05:01:01 AM 4693780 6993876 3188656 40.45 2688 2469112 898892 10.06 397920 2414756 40 05:02:01 AM 4753760 7058272 3128676 39.69 2688 2473528 631648 7.07 398816 2355640 4412 05:03:01 AM 4695264 6902892 3187172 40.43 2688 2382376 750720 8.41 633712 2201416 14464 Average: 4730862 7003271 3151574 39.98 2688 2441500 728909 8.16 391619 2385973 412 12:00:00 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:00:01 AM eth0 29.63 33.33 7.97 4.96 0.00 0.00 0.00 0.00 12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:01:01 AM eth0 45.63 38.02 713.87 3.83 0.00 0.00 0.00 0.00 12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:02:01 AM eth0 9.84 9.68 2.04 1.81 0.00 0.00 0.00 0.00 12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:03:01 AM eth0 14.58 14.06 3.34 2.58 0.00 0.00 0.00 0.00 12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:04:01 AM eth0 0.63 0.35 0.09 0.05 0.00 0.00 0.00 0.00 12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:05:01 AM eth0 1.37 0.35 0.42 0.26 0.00 0.00 0.00 0.00 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:06:01 AM eth0 0.78 0.43 0.17 0.11 0.00 0.00 0.00 0.00 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:07:01 AM eth0 0.32 0.00 0.02 0.00 0.00 0.00 0.00 0.00 12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:08:01 AM eth0 0.33 0.28 0.06 0.04 0.00 0.00 0.00 0.00 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:09:01 AM eth0 0.25 0.07 0.01 0.00 0.00 0.00 0.00 0.00 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:10:01 AM eth0 3.55 3.52 0.78 0.66 0.00 0.00 0.00 0.00 12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:11:01 AM eth0 7.83 7.55 1.41 0.61 0.00 0.00 0.00 0.00 12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:12:01 AM eth0 0.72 0.58 0.13 0.09 0.00 0.00 0.00 0.00 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:13:01 AM eth0 0.47 0.18 0.03 0.01 0.00 0.00 0.00 0.00 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:14:01 AM eth0 0.33 0.05 0.02 0.00 0.00 0.00 0.00 0.00 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:15:01 AM eth0 0.22 0.00 0.01 0.00 0.00 0.00 0.00 0.00 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:16:01 AM eth0 2.37 2.17 0.50 0.22 0.00 0.00 0.00 0.00 12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:17:01 AM eth0 9.55 9.60 2.04 1.79 0.00 0.00 0.00 0.00 12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:18:01 AM eth0 9.43 9.73 2.02 1.81 0.00 0.00 0.00 0.00 12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:19:01 AM eth0 9.00 8.90 1.95 1.66 0.00 0.00 0.00 0.00 12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:01 AM eth0 9.28 9.46 1.99 1.77 0.00 0.00 0.00 0.00 12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 AM eth0 9.55 9.76 2.07 1.85 0.00 0.00 0.00 0.00 12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:22:01 AM eth0 9.67 9.77 2.03 1.81 0.00 0.00 0.00 0.00 12:23:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:23:02 AM eth0 4.03 4.03 0.83 0.75 0.00 0.00 0.00 0.00 12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:24:01 AM eth0 0.64 0.46 0.07 0.07 0.00 0.00 0.00 0.00 12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 AM eth0 0.23 0.00 0.01 0.00 0.00 0.00 0.00 0.00 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 AM eth0 2.13 1.83 0.43 0.40 0.00 0.00 0.00 0.00 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 AM eth0 8.08 7.83 1.71 1.45 0.00 0.00 0.00 0.00 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 AM eth0 9.52 9.63 2.02 1.81 0.00 0.00 0.00 0.00 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 AM eth0 9.55 9.61 2.03 1.80 0.00 0.00 0.00 0.00 12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:01 AM eth0 9.36 9.58 2.01 1.80 0.00 0.00 0.00 0.00 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 AM eth0 9.27 9.38 2.03 1.80 0.00 0.00 0.00 0.00 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 AM eth0 10.06 9.85 2.17 1.88 0.00 0.00 0.00 0.00 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 AM eth0 18.61 15.53 3.89 2.99 0.00 0.00 0.00 0.00 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 AM eth0 1.87 0.53 0.46 0.25 0.00 0.00 0.00 0.00 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 AM eth0 0.65 0.33 0.59 0.20 0.00 0.00 0.00 0.00 12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:01 AM eth0 0.77 0.43 0.18 0.11 0.00 0.00 0.00 0.00 12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 AM eth0 0.23 0.10 0.07 0.01 0.00 0.00 0.00 0.00 12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 AM eth0 0.40 0.32 0.08 0.04 0.00 0.00 0.00 0.00 12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:01 AM eth0 0.25 0.07 0.01 0.00 0.00 0.00 0.00 0.00 12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 AM eth0 0.92 0.87 0.20 0.15 0.00 0.00 0.00 0.00 12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 AM eth0 8.76 7.78 1.64 0.95 0.00 0.00 0.00 0.00 12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 AM eth0 3.42 2.58 0.98 0.48 0.00 0.00 0.00 0.00 12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 AM eth0 0.55 0.25 0.26 0.19 0.00 0.00 0.00 0.00 12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 AM eth0 2.87 2.23 0.73 0.35 0.00 0.00 0.00 0.00 12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 AM eth0 8.56 7.66 2.02 1.63 0.00 0.00 0.00 0.00 12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:01 AM eth0 9.48 9.40 2.09 1.82 0.00 0.00 0.00 0.00 12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 AM eth0 9.88 9.97 2.29 2.01 0.00 0.00 0.00 0.00 12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 AM eth0 9.45 9.56 2.02 1.80 0.00 0.00 0.00 0.00 12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 AM eth0 8.78 8.98 1.89 1.67 0.00 0.00 0.00 0.00 12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:01 AM eth0 9.33 9.55 2.01 1.80 0.00 0.00 0.00 0.00 12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 AM eth0 6.28 6.38 1.38 1.24 0.00 0.00 0.00 0.00 12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 AM eth0 0.77 0.62 0.08 0.10 0.00 0.00 0.00 0.00 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 7.87 7.88 1.59 1.48 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 9.75 9.75 2.11 1.81 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 9.01 9.25 1.94 1.73 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 9.53 9.78 2.10 1.87 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 9.78 9.38 2.09 1.80 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 8.91 9.06 2.11 1.86 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 3.73 3.65 0.73 0.69 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 2.30 2.13 0.41 0.41 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 11.09 10.64 2.60 2.03 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 8.71 8.70 2.04 1.79 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 9.35 9.31 2.00 1.75 0.00 0.00 0.00 0.00 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 AM eth0 11.26 9.53 2.32 1.81 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 9.65 9.55 2.43 2.11 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 9.73 9.57 2.10 1.83 0.00 0.00 0.00 0.00 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 AM eth0 13.31 12.43 3.05 2.32 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 6.33 0.33 1.00 0.27 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 1.25 0.57 0.83 0.58 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 0.53 0.33 0.10 0.06 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 7.13 0.10 1.02 0.06 0.00 0.00 0.00 0.00 01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:01 AM eth0 1.67 0.43 0.20 0.05 0.00 0.00 0.00 0.00 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 AM eth0 1.12 0.07 0.09 0.00 0.00 0.00 0.00 0.00 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 AM eth0 8.35 7.88 1.81 1.21 0.00 0.00 0.00 0.00 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 AM eth0 2.77 2.42 0.56 0.25 0.00 0.00 0.00 0.00 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 AM eth0 1.93 0.37 0.38 0.10 0.00 0.00 0.00 0.00 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 AM eth0 0.95 0.10 0.08 0.00 0.00 0.00 0.00 0.00 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 AM eth0 5.58 5.53 1.17 0.85 0.00 0.00 0.00 0.00 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 AM eth0 9.23 9.30 1.95 1.74 0.00 0.00 0.00 0.00 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 AM eth0 9.50 9.55 2.02 1.80 0.00 0.00 0.00 0.00 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 AM eth0 9.68 9.67 2.10 1.86 0.00 0.00 0.00 0.00 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 AM eth0 8.73 8.90 1.86 1.66 0.00 0.00 0.00 0.00 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 AM eth0 11.60 9.75 2.31 1.87 0.00 0.00 0.00 0.00 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 AM eth0 12.83 10.11 2.87 2.21 0.00 0.00 0.00 0.00 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 AM eth0 2.25 1.57 0.87 0.63 0.00 0.00 0.00 0.00 01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:01 AM eth0 3.82 3.20 0.78 0.63 0.00 0.00 0.00 0.00 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 AM eth0 17.91 9.92 3.18 1.83 0.00 0.00 0.00 0.00 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 AM eth0 10.60 9.58 2.27 1.94 0.00 0.00 0.00 0.00 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 AM eth0 9.82 9.55 2.04 1.80 0.00 0.00 0.00 0.00 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 AM eth0 9.65 9.70 2.03 1.81 0.00 0.00 0.00 0.00 01:31:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:02 AM eth0 10.18 9.70 2.12 1.87 0.00 0.00 0.00 0.00 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 AM eth0 10.13 9.59 2.14 1.84 0.00 0.00 0.00 0.00 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 AM eth0 12.31 11.90 2.99 2.32 0.00 0.00 0.00 0.00 01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 AM eth0 0.10 0.03 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM eth0 0.45 0.00 0.06 0.00 0.00 0.00 0.00 0.00 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 AM eth0 0.73 0.48 0.17 0.11 0.00 0.00 0.00 0.00 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 AM eth0 0.20 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 AM eth0 0.63 0.33 0.12 0.04 0.00 0.00 0.00 0.00 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 AM eth0 0.17 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 AM eth0 8.22 8.07 1.54 0.96 0.00 0.00 0.00 0.00 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 AM eth0 4.38 3.63 0.95 0.39 0.00 0.00 0.00 0.00 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 AM eth0 0.48 0.30 0.08 0.03 0.00 0.00 0.00 0.00 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 AM eth0 0.30 0.10 0.02 0.00 0.00 0.00 0.00 0.00 01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:01 AM eth0 1.02 0.28 0.24 0.03 0.00 0.00 0.00 0.00 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 AM eth0 0.17 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 AM eth0 0.47 0.37 0.17 0.10 0.00 0.00 0.00 0.00 01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:01 AM eth0 0.45 0.22 0.26 0.20 0.00 0.00 0.00 0.00 01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:01 AM eth0 0.45 0.35 0.08 0.04 0.00 0.00 0.00 0.00 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 AM eth0 0.48 0.25 0.12 0.03 0.00 0.00 0.00 0.00 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 AM eth0 0.28 0.12 0.08 0.06 0.00 0.00 0.00 0.00 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 AM eth0 0.40 0.27 0.08 0.03 0.00 0.00 0.00 0.00 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 AM eth0 0.20 0.05 0.01 0.00 0.00 0.00 0.00 0.00 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 AM eth0 0.38 0.28 0.08 0.03 0.00 0.00 0.00 0.00 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 AM eth0 0.20 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 AM eth0 3.00 2.67 0.55 0.27 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 7.57 7.78 1.59 1.44 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 9.33 9.53 2.02 1.80 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 9.35 9.65 2.02 1.81 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 9.38 9.56 2.02 1.80 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 9.34 9.39 2.05 1.84 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 10.01 9.77 2.17 1.88 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 6.28 6.33 1.52 1.34 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 1.27 0.72 0.21 0.15 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 1.00 0.28 0.40 0.26 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 0.88 0.60 0.67 0.28 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 0.12 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 0.30 0.20 0.01 0.02 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 0.35 0.25 0.02 0.02 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 1.00 0.20 0.24 0.13 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 0.52 0.25 0.26 0.20 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 0.22 0.07 0.01 0.00 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 0.23 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 0.45 0.20 0.06 0.02 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 0.27 0.12 0.08 0.06 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 3.80 3.78 0.74 0.71 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 9.60 9.57 2.07 1.80 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 8.68 8.88 1.86 1.65 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 9.21 9.51 1.97 1.76 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 9.53 9.73 2.09 1.87 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 9.46 9.73 2.02 1.81 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 9.62 9.75 1.93 8.13 0.00 0.00 0.00 0.00 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 AM eth0 2.68 1.87 0.69 11.11 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 0.05 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 0.43 0.30 0.09 0.08 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 0.15 0.05 0.01 0.00 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 0.27 0.20 0.01 0.02 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 2.15 0.10 0.34 0.07 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 0.98 0.35 0.35 0.21 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 0.45 0.25 0.13 0.13 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 6.48 0.30 0.82 0.09 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 1.72 0.55 0.69 0.46 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 1.13 0.40 0.68 0.39 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 0.32 0.20 0.02 0.02 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 3.42 0.13 0.52 0.07 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 8.97 4.38 1.42 0.83 0.00 0.00 0.00 0.00 02:38:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:02 AM eth0 9.75 9.43 2.00 1.75 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 9.02 8.88 1.87 1.66 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 9.65 9.63 2.01 1.78 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 9.48 9.38 2.03 1.80 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 10.38 9.68 2.10 1.81 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 9.88 8.70 2.00 1.62 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 2.68 0.55 0.38 0.14 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 1.02 0.18 0.32 0.19 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 0.80 0.47 0.35 0.27 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 1.60 0.33 0.46 0.26 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 1.82 0.37 0.43 0.21 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 1.17 0.13 0.18 0.07 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 0.92 0.32 0.33 0.20 0.00 0.00 0.00 0.00 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 AM eth0 0.57 0.22 0.16 0.07 0.00 0.00 0.00 0.00 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 AM eth0 2.07 0.18 0.23 0.02 0.00 0.00 0.00 0.00 02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:01 AM eth0 0.33 0.05 0.02 0.00 0.00 0.00 0.00 0.00 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 AM eth0 2.67 0.15 0.32 0.01 0.00 0.00 0.00 0.00 02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:01 AM eth0 2.55 0.72 0.91 0.59 0.00 0.00 0.00 0.00 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 AM eth0 0.77 0.28 0.35 0.26 0.00 0.00 0.00 0.00 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 AM eth0 6.60 2.37 1.19 0.62 0.00 0.00 0.00 0.00 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 AM eth0 13.35 10.98 2.60 2.04 0.00 0.00 0.00 0.00 02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:01 AM eth0 9.65 8.93 1.93 1.66 0.00 0.00 0.00 0.00 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 9.73 9.63 2.03 1.81 0.00 0.00 0.00 0.00 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 AM eth0 11.66 9.50 17.27 1.83 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 9.96 9.51 2.06 1.78 0.00 0.00 0.00 0.00 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 AM eth0 9.90 9.82 2.39 2.00 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 12.61 12.25 2.83 2.23 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 0.75 0.30 0.12 0.04 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 0.67 0.12 0.15 0.06 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 1.18 0.42 0.20 0.05 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 0.47 0.33 0.07 0.05 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 0.15 0.05 0.01 0.00 0.00 0.00 0.00 0.00 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 AM eth0 7.93 7.82 1.59 1.03 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 21.66 16.99 281.72 1.31 0.00 0.00 0.00 0.00 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 AM eth0 2.88 0.90 2.91 0.13 0.00 0.00 0.00 0.00 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 AM eth0 0.32 0.17 0.02 0.01 0.00 0.00 0.00 0.00 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 AM eth0 2.18 2.15 0.48 0.22 0.00 0.00 0.00 0.00 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 AM eth0 10.95 11.21 2.39 2.13 0.00 0.00 0.00 0.00 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 AM eth0 9.46 9.71 2.02 1.81 0.00 0.00 0.00 0.00 03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:18:01 AM eth0 9.40 9.63 2.02 1.80 0.00 0.00 0.00 0.00 03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 AM eth0 9.33 9.40 1.98 1.76 0.00 0.00 0.00 0.00 03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 AM eth0 9.30 9.53 1.99 1.78 0.00 0.00 0.00 0.00 03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:21:01 AM eth0 9.55 9.82 2.10 1.88 0.00 0.00 0.00 0.00 03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:22:01 AM eth0 4.18 2.10 0.54 0.39 0.00 0.00 0.00 0.00 03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:23:01 AM eth0 4.08 3.73 0.80 0.69 0.00 0.00 0.00 0.00 03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:24:01 AM eth0 9.43 9.72 2.02 1.81 0.00 0.00 0.00 0.00 03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:25:01 AM eth0 9.35 9.65 2.01 1.81 0.00 0.00 0.00 0.00 03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:26:01 AM eth0 9.02 9.20 1.95 1.79 0.00 0.00 0.00 0.00 03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:27:01 AM eth0 9.40 9.68 2.02 1.81 0.00 0.00 0.00 0.00 03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:28:01 AM eth0 9.20 9.43 1.96 1.75 0.00 0.00 0.00 0.00 03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:29:01 AM eth0 8.73 8.98 1.87 1.69 0.00 0.00 0.00 0.00 03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:30:01 AM eth0 2.37 2.30 0.41 0.42 0.00 0.00 0.00 0.00 03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:31:01 AM eth0 6.23 6.31 1.35 1.22 0.00 0.00 0.00 0.00 03:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:32:01 AM eth0 10.20 9.77 2.18 1.88 0.00 0.00 0.00 0.00 03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:33:01 AM eth0 9.60 9.78 2.26 1.99 0.00 0.00 0.00 0.00 03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:34:01 AM eth0 9.35 9.68 2.02 1.81 0.00 0.00 0.00 0.00 03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:35:01 AM eth0 9.20 9.40 1.97 1.76 0.00 0.00 0.00 0.00 03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:36:01 AM eth0 9.48 9.68 2.07 1.85 0.00 0.00 0.00 0.00 03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:37:01 AM eth0 17.08 16.90 3.83 3.13 0.00 0.00 0.00 0.00 03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:38:01 AM eth0 0.57 0.50 0.10 0.07 0.00 0.00 0.00 0.00 03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:39:01 AM eth0 0.08 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:40:01 AM eth0 0.64 0.53 0.41 0.06 0.00 0.00 0.00 0.00 03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:41:01 AM eth0 0.33 0.17 0.09 0.07 0.00 0.00 0.00 0.00 03:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:42:01 AM eth0 0.18 0.05 0.01 0.00 0.00 0.00 0.00 0.00 03:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:43:01 AM eth0 0.38 0.27 0.07 0.04 0.00 0.00 0.00 0.00 03:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:44:01 AM eth0 0.35 0.05 0.02 0.00 0.00 0.00 0.00 0.00 03:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:45:01 AM eth0 8.18 8.25 1.58 1.02 0.00 0.00 0.00 0.00 03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:01 AM eth0 3.67 3.72 0.73 0.37 0.00 0.00 0.00 0.00 03:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:47:01 AM eth0 0.38 0.18 0.26 0.19 0.00 0.00 0.00 0.00 03:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:48:01 AM eth0 2.08 2.02 0.51 0.16 0.00 0.00 0.00 0.00 03:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:49:01 AM eth0 2.78 2.78 0.55 0.24 0.00 0.00 0.00 0.00 03:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:50:01 AM eth0 7.02 6.90 1.30 0.58 0.00 0.00 0.00 0.00 03:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:51:01 AM eth0 4.77 4.72 0.77 0.43 0.00 0.00 0.00 0.00 03:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:52:01 AM eth0 0.60 0.57 0.07 0.09 0.00 0.00 0.00 0.00 03:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:53:01 AM eth0 0.08 0.03 0.00 0.00 0.00 0.00 0.00 0.00 03:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:54:01 AM eth0 6.23 6.32 1.23 0.71 0.00 0.00 0.00 0.00 03:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:55:01 AM eth0 9.20 9.60 1.93 1.76 0.00 0.00 0.00 0.00 03:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:56:01 AM eth0 9.57 9.85 2.10 1.88 0.00 0.00 0.00 0.00 03:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:57:01 AM eth0 9.33 9.70 2.01 1.81 0.00 0.00 0.00 0.00 03:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:58:01 AM eth0 10.05 9.65 2.38 2.04 0.00 0.00 0.00 0.00 03:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:59:01 AM eth0 9.18 9.47 1.97 1.76 0.00 0.00 0.00 0.00 04:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:00:01 AM eth0 9.33 9.55 2.01 1.80 0.00 0.00 0.00 0.00 04:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:01:01 AM eth0 15.03 14.73 3.44 2.77 0.00 0.00 0.00 0.00 04:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:02:01 AM eth0 0.43 0.37 0.08 0.05 0.00 0.00 0.00 0.00 04:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:03:01 AM eth0 0.22 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:04:01 AM eth0 0.63 0.32 0.08 0.04 0.00 0.00 0.00 0.00 04:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:05:01 AM eth0 0.18 0.03 0.01 0.00 0.00 0.00 0.00 0.00 04:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:06:01 AM eth0 0.50 0.43 0.14 0.11 0.00 0.00 0.00 0.00 04:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:07:01 AM eth0 0.07 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:08:01 AM eth0 3.37 3.48 0.77 0.65 0.00 0.00 0.00 0.00 04:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:09:01 AM eth0 7.56 7.61 1.35 0.56 0.00 0.00 0.00 0.00 04:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:10:01 AM eth0 0.57 0.62 0.07 0.10 0.00 0.00 0.00 0.00 04:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:11:01 AM eth0 0.30 0.23 0.08 0.07 0.00 0.00 0.00 0.00 04:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:12:01 AM eth0 2.65 2.62 0.53 0.19 0.00 0.00 0.00 0.00 04:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:13:01 AM eth0 7.03 7.07 1.17 0.59 0.00 0.00 0.00 0.00 04:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:14:01 AM eth0 3.53 3.00 0.82 0.44 0.00 0.00 0.00 0.00 04:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:15:01 AM eth0 5.67 5.75 0.85 0.58 0.00 0.00 0.00 0.00 04:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:16:01 AM eth0 0.77 0.20 0.14 0.07 0.00 0.00 0.00 0.00 04:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:17:01 AM eth0 0.37 0.25 0.26 0.20 0.00 0.00 0.00 0.00 04:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:18:01 AM eth0 10.46 9.25 1.88 1.14 0.00 0.00 0.00 0.00 04:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:19:01 AM eth0 10.03 10.10 2.12 1.89 0.00 0.00 0.00 0.00 04:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:20:01 AM eth0 8.88 9.03 1.88 1.68 0.00 0.00 0.00 0.00 04:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:21:01 AM eth0 13.56 9.80 2.63 1.87 0.00 0.00 0.00 0.00 04:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:22:01 AM eth0 11.23 9.40 2.62 1.81 0.00 0.00 0.00 0.00 04:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:23:01 AM eth0 9.92 9.97 2.29 2.01 0.00 0.00 0.00 0.00 04:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:24:01 AM eth0 9.42 9.60 2.02 1.80 0.00 0.00 0.00 0.00 04:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:25:01 AM eth0 20.16 12.01 3.85 2.17 0.00 0.00 0.00 0.00 04:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:26:01 AM eth0 3.52 0.47 0.45 0.11 0.00 0.00 0.00 0.00 04:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:27:01 AM eth0 0.63 0.00 0.04 0.00 0.00 0.00 0.00 0.00 04:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:28:01 AM eth0 0.75 0.38 0.09 0.05 0.00 0.00 0.00 0.00 04:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:29:01 AM eth0 0.58 0.02 0.03 0.00 0.00 0.00 0.00 0.00 04:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:30:01 AM eth0 1.60 0.32 0.16 0.04 0.00 0.00 0.00 0.00 04:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:31:01 AM eth0 1.30 0.13 0.17 0.07 0.00 0.00 0.00 0.00 04:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:32:01 AM eth0 9.28 7.80 1.85 1.01 0.00 0.00 0.00 0.00 04:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:33:01 AM eth0 3.43 2.70 0.82 0.41 0.00 0.00 0.00 0.00 04:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:34:01 AM eth0 1.10 0.67 0.34 0.28 0.00 0.00 0.00 0.00 04:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:35:01 AM eth0 0.38 0.10 0.02 0.00 0.00 0.00 0.00 0.00 04:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:36:01 AM eth0 4.18 3.23 0.73 0.33 0.00 0.00 0.00 0.00 04:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:37:01 AM eth0 0.97 0.02 0.10 0.00 0.00 0.00 0.00 0.00 04:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:38:01 AM eth0 3.03 2.82 0.60 0.25 0.00 0.00 0.00 0.00 04:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:39:01 AM eth0 0.28 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:01 AM eth0 2.47 2.42 0.49 0.45 0.00 0.00 0.00 0.00 04:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:41:01 AM eth0 8.60 8.63 1.66 1.10 0.00 0.00 0.00 0.00 04:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:42:01 AM eth0 9.50 9.65 2.02 1.81 0.00 0.00 0.00 0.00 04:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:43:01 AM eth0 9.55 9.63 2.02 1.81 0.00 0.00 0.00 0.00 04:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:44:01 AM eth0 12.36 9.57 2.64 2.00 0.00 0.00 0.00 0.00 04:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:45:01 AM eth0 10.11 9.85 2.59 2.14 0.00 0.00 0.00 0.00 04:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:46:01 AM eth0 9.68 9.63 2.13 1.86 0.00 0.00 0.00 0.00 04:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:47:01 AM eth0 14.70 10.53 2.95 2.12 0.00 0.00 0.00 0.00 04:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:48:01 AM eth0 12.16 10.88 2.66 1.94 0.00 0.00 0.00 0.00 04:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:49:01 AM eth0 0.48 0.03 0.03 0.00 0.00 0.00 0.00 0.00 04:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:50:01 AM eth0 0.33 0.00 0.02 0.00 0.00 0.00 0.00 0.00 04:51:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:51:02 AM eth0 0.85 0.43 0.16 0.11 0.00 0.00 0.00 0.00 04:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:52:01 AM eth0 0.14 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:53:01 AM eth0 1.25 0.42 0.23 0.11 0.00 0.00 0.00 0.00 04:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:54:01 AM eth0 0.45 0.15 0.26 0.19 0.00 0.00 0.00 0.00 04:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:55:01 AM eth0 7.62 7.50 1.54 0.97 0.00 0.00 0.00 0.00 04:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:56:01 AM eth0 5.71 5.65 1.33 0.87 0.00 0.00 0.00 0.00 04:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:57:01 AM eth0 5.97 5.73 1.33 0.85 0.00 0.00 0.00 0.00 04:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:58:01 AM eth0 5.53 5.52 1.29 0.80 0.00 0.00 0.00 0.00 04:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:59:01 AM eth0 5.57 5.40 1.32 0.87 0.00 0.00 0.00 0.00 05:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:00:01 AM eth0 10.30 10.33 3.50 1.46 0.00 0.00 0.00 0.00 05:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:01:01 AM eth0 12.40 12.31 2.40 1.31 0.00 0.00 0.00 0.00 05:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:02:01 AM eth0 26.06 16.98 13.98 2.32 0.00 0.00 0.00 0.00 05:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:03:01 AM eth0 91.87 70.61 267.30 299.50 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 5.73 5.09 5.36 1.92 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-9627.novalocal) 04/21/2024 _x86_64_ (2 CPU) 12:00:00 AM CPU %user %nice %system %iowait %steal %idle 12:00:01 AM all 7.78 25.19 7.78 0.74 0.00 58.52 12:00:01 AM 0 14.18 2.24 12.69 1.49 0.00 69.40 12:00:01 AM 1 1.47 47.79 2.94 0.00 0.00 47.79 12:01:01 AM all 4.22 10.42 0.84 1.88 0.09 82.55 12:01:01 AM 0 4.90 15.48 1.04 1.28 0.10 77.20 12:01:01 AM 1 3.55 5.39 0.64 2.48 0.08 87.87 12:02:01 AM all 4.39 0.00 0.37 0.14 0.06 95.04 12:02:01 AM 0 6.23 0.00 0.49 0.17 0.07 93.05 12:02:01 AM 1 2.56 0.00 0.25 0.12 0.05 97.02 12:03:01 AM all 5.50 0.00 0.28 0.00 0.08 94.14 12:03:01 AM 0 8.17 0.00 0.35 0.00 0.07 91.41 12:03:01 AM 1 2.84 0.00 0.22 0.00 0.08 96.86 12:04:01 AM all 0.57 0.00 0.08 0.00 0.04 99.32 12:04:01 AM 0 0.48 0.00 0.08 0.00 0.05 99.38 12:04:01 AM 1 0.65 0.00 0.07 0.00 0.03 99.25 12:05:01 AM all 0.24 0.00 0.09 0.01 0.03 99.62 12:05:01 AM 0 0.13 0.00 0.10 0.00 0.05 99.72 12:05:01 AM 1 0.35 0.00 0.08 0.02 0.02 99.53 12:06:01 AM all 0.43 0.00 0.08 0.00 0.06 99.44 12:06:01 AM 0 0.45 0.00 0.10 0.00 0.07 99.38 12:06:01 AM 1 0.40 0.00 0.05 0.00 0.05 99.50 12:07:01 AM all 0.33 0.00 0.06 0.00 0.03 99.57 12:07:01 AM 0 0.13 0.00 0.08 0.00 0.05 99.73 12:07:01 AM 1 0.53 0.00 0.03 0.00 0.02 99.42 12:08:01 AM all 0.51 0.00 0.13 0.00 0.04 99.32 12:08:01 AM 0 0.42 0.00 0.20 0.00 0.03 99.35 12:08:01 AM 1 0.60 0.00 0.05 0.00 0.05 99.30 12:09:01 AM all 0.32 0.00 0.03 0.00 0.05 99.60 12:09:01 AM 0 0.10 0.00 0.05 0.00 0.07 99.78 12:09:01 AM 1 0.53 0.00 0.02 0.00 0.03 99.42 12:10:01 AM all 1.95 0.00 0.14 0.00 0.05 97.86 12:10:01 AM 0 3.19 0.00 0.19 0.00 0.05 96.57 12:10:01 AM 1 0.72 0.00 0.10 0.00 0.05 99.13 12:10:01 AM CPU %user %nice %system %iowait %steal %idle 12:11:01 AM all 5.97 0.00 2.37 0.00 0.05 91.61 12:11:01 AM 0 3.99 0.00 0.36 0.00 0.05 95.59 12:11:01 AM 1 8.04 0.00 4.47 0.00 0.05 87.43 12:12:01 AM all 2.97 0.00 1.12 0.00 0.07 95.84 12:12:01 AM 0 5.40 0.00 2.19 0.00 0.05 92.35 12:12:01 AM 1 0.63 0.00 0.10 0.00 0.08 99.18 12:13:01 AM all 0.34 0.00 0.05 0.00 0.04 99.57 12:13:01 AM 0 0.17 0.00 0.08 0.00 0.07 99.68 12:13:01 AM 1 0.52 0.00 0.02 0.00 0.02 99.45 12:14:01 AM all 0.46 0.00 0.08 0.00 0.06 99.40 12:14:01 AM 0 0.27 0.00 0.10 0.00 0.07 99.57 12:14:01 AM 1 0.65 0.00 0.07 0.00 0.05 99.23 12:15:01 AM all 0.53 0.00 0.08 0.01 0.07 99.32 12:15:01 AM 0 0.40 0.00 0.10 0.00 0.07 99.43 12:15:01 AM 1 0.65 0.00 0.05 0.02 0.07 99.22 12:16:01 AM all 3.34 0.00 1.00 0.00 0.07 95.59 12:16:01 AM 0 6.13 0.00 1.89 0.00 0.09 91.89 12:16:01 AM 1 0.68 0.00 0.15 0.00 0.05 99.12 12:17:01 AM all 5.22 0.00 0.35 0.00 0.08 94.35 12:17:01 AM 0 6.30 0.00 0.53 0.00 0.09 93.09 12:17:01 AM 1 4.17 0.00 0.18 0.00 0.07 95.58 12:18:01 AM all 4.32 0.00 0.19 0.00 0.07 95.42 12:18:01 AM 0 4.11 0.00 0.17 0.00 0.07 95.65 12:18:01 AM 1 4.52 0.00 0.22 0.00 0.07 95.20 12:19:01 AM all 3.92 0.00 0.17 0.00 0.07 95.85 12:19:01 AM 0 4.27 0.00 0.17 0.00 0.07 95.50 12:19:01 AM 1 3.56 0.00 0.17 0.00 0.07 96.20 12:20:01 AM all 4.17 0.00 0.19 0.00 0.07 95.57 12:20:01 AM 0 3.83 0.00 0.18 0.00 0.07 95.92 12:20:01 AM 1 4.50 0.00 0.20 0.00 0.07 95.23 12:21:01 AM all 4.22 0.00 0.18 0.01 0.08 95.51 12:21:01 AM 0 2.58 0.00 0.18 0.02 0.07 97.16 12:21:01 AM 1 5.87 0.00 0.18 0.00 0.08 93.86 12:21:01 AM CPU %user %nice %system %iowait %steal %idle 12:22:01 AM all 4.25 0.00 0.18 0.00 0.07 95.51 12:22:01 AM 0 6.19 0.00 0.20 0.00 0.08 93.52 12:22:01 AM 1 2.31 0.00 0.15 0.00 0.05 97.49 12:23:02 AM all 5.95 0.00 0.38 0.00 0.07 93.61 12:23:02 AM 0 10.26 0.00 0.58 0.00 0.05 89.10 12:23:02 AM 1 1.85 0.00 0.18 0.00 0.08 97.88 12:24:01 AM all 2.72 0.00 1.24 0.00 0.06 95.98 12:24:01 AM 0 4.91 0.00 2.43 0.00 0.07 92.59 12:24:01 AM 1 0.61 0.00 0.08 0.00 0.05 99.25 12:25:01 AM all 0.52 0.00 0.08 0.00 0.06 99.34 12:25:01 AM 0 0.33 0.00 0.10 0.00 0.07 99.50 12:25:01 AM 1 0.70 0.00 0.07 0.00 0.05 99.18 12:26:01 AM all 4.12 0.00 0.29 0.00 0.08 95.51 12:26:01 AM 0 7.78 0.00 0.42 0.00 0.07 91.74 12:26:01 AM 1 0.59 0.00 0.17 0.00 0.08 99.16 12:27:01 AM all 5.47 0.00 2.22 0.00 0.07 92.25 12:27:01 AM 0 9.55 0.00 4.33 0.00 0.07 86.05 12:27:01 AM 1 1.54 0.00 0.18 0.00 0.07 98.21 12:28:01 AM all 4.33 0.00 0.29 0.00 0.07 95.31 12:28:01 AM 0 2.47 0.00 0.20 0.00 0.07 97.26 12:28:01 AM 1 6.18 0.00 0.39 0.00 0.07 93.37 12:29:01 AM all 4.25 0.00 0.30 0.00 0.08 95.37 12:29:01 AM 0 6.22 0.00 0.39 0.00 0.08 93.32 12:29:01 AM 1 2.29 0.00 0.22 0.00 0.07 97.43 12:30:01 AM all 4.23 0.00 0.28 0.00 0.06 95.44 12:30:01 AM 0 4.10 0.00 0.28 0.00 0.05 95.56 12:30:01 AM 1 4.35 0.00 0.27 0.00 0.07 95.32 12:31:01 AM all 4.08 0.00 0.33 0.00 0.07 95.53 12:31:01 AM 0 4.79 0.00 0.37 0.00 0.07 94.78 12:31:01 AM 1 3.37 0.00 0.28 0.00 0.07 96.28 12:32:01 AM all 4.24 0.00 0.31 0.00 0.06 95.39 12:32:01 AM 0 3.56 0.00 0.28 0.00 0.07 96.09 12:32:01 AM 1 4.92 0.00 0.33 0.00 0.05 94.69 12:32:01 AM CPU %user %nice %system %iowait %steal %idle 12:33:01 AM all 5.77 0.00 0.33 0.00 0.08 93.81 12:33:01 AM 0 5.93 0.00 0.33 0.00 0.08 93.65 12:33:01 AM 1 5.61 0.00 0.34 0.00 0.08 93.97 12:34:01 AM all 0.57 0.00 0.08 0.00 0.05 99.31 12:34:01 AM 0 0.53 0.00 0.07 0.00 0.03 99.37 12:34:01 AM 1 0.60 0.00 0.08 0.00 0.07 99.25 12:35:01 AM all 0.34 0.00 0.06 0.00 0.03 99.57 12:35:01 AM 0 0.17 0.00 0.08 0.00 0.05 99.70 12:35:01 AM 1 0.52 0.00 0.03 0.00 0.02 99.43 12:36:01 AM all 0.50 0.00 0.08 0.00 0.03 99.39 12:36:01 AM 0 0.43 0.00 0.10 0.00 0.03 99.43 12:36:01 AM 1 0.57 0.00 0.05 0.00 0.03 99.35 12:37:01 AM all 0.11 0.00 0.07 0.00 0.03 99.79 12:37:01 AM 0 0.03 0.00 0.02 0.00 0.02 99.93 12:37:01 AM 1 0.18 0.00 0.12 0.00 0.05 99.65 12:38:01 AM all 0.48 0.00 0.08 0.00 0.04 99.40 12:38:01 AM 0 0.43 0.00 0.10 0.00 0.05 99.42 12:38:01 AM 1 0.53 0.00 0.05 0.00 0.03 99.38 12:39:01 AM all 0.34 0.00 0.06 0.00 0.05 99.55 12:39:01 AM 0 0.08 0.00 0.07 0.00 0.05 99.80 12:39:01 AM 1 0.60 0.00 0.05 0.00 0.05 99.30 12:40:01 AM all 0.65 0.00 0.06 0.00 0.04 99.25 12:40:01 AM 0 0.68 0.00 0.07 0.00 0.03 99.22 12:40:01 AM 1 0.62 0.00 0.05 0.00 0.05 99.28 12:41:01 AM all 6.50 0.00 2.74 0.00 0.07 90.69 12:41:01 AM 0 12.63 0.00 5.50 0.00 0.07 81.80 12:41:01 AM 1 0.82 0.00 0.17 0.00 0.07 98.95 12:42:01 AM all 4.08 0.00 1.37 0.00 0.05 94.50 12:42:01 AM 0 8.00 0.00 2.65 0.00 0.05 89.30 12:42:01 AM 1 0.42 0.00 0.17 0.00 0.05 99.36 12:43:01 AM all 0.33 0.00 0.08 0.00 0.04 99.55 12:43:01 AM 0 0.07 0.00 0.07 0.00 0.03 99.83 12:43:01 AM 1 0.60 0.00 0.08 0.00 0.05 99.26 12:43:01 AM CPU %user %nice %system %iowait %steal %idle 12:44:01 AM all 2.05 0.00 0.17 0.00 0.04 97.74 12:44:01 AM 0 3.43 0.00 0.27 0.00 0.03 96.27 12:44:01 AM 1 0.68 0.00 0.07 0.00 0.05 99.20 12:45:01 AM all 6.09 0.00 1.33 0.01 0.07 92.50 12:45:01 AM 0 7.86 0.00 2.35 0.02 0.09 89.69 12:45:01 AM 1 4.35 0.00 0.32 0.00 0.05 95.28 12:46:01 AM all 4.19 0.00 0.17 0.00 0.07 95.58 12:46:01 AM 0 5.05 0.00 0.22 0.00 0.07 94.66 12:46:01 AM 1 3.33 0.00 0.12 0.00 0.07 96.49 12:47:01 AM all 4.48 0.00 0.23 0.00 0.06 95.22 12:47:01 AM 0 6.64 0.00 0.28 0.00 0.07 93.00 12:47:01 AM 1 2.32 0.00 0.18 0.00 0.05 97.44 12:48:01 AM all 4.46 0.00 0.20 0.00 0.08 95.27 12:48:01 AM 0 5.69 0.00 0.22 0.00 0.08 94.01 12:48:01 AM 1 3.23 0.00 0.18 0.00 0.07 96.52 12:49:01 AM all 4.15 0.00 0.22 0.00 0.08 95.54 12:49:01 AM 0 4.30 0.00 0.23 0.00 0.08 95.38 12:49:01 AM 1 4.01 0.00 0.20 0.00 0.08 95.71 12:50:01 AM all 4.32 0.01 0.18 0.02 0.08 95.40 12:50:01 AM 0 6.47 0.02 0.20 0.03 0.08 93.19 12:50:01 AM 1 2.17 0.00 0.15 0.00 0.08 97.59 12:51:01 AM all 4.94 0.00 0.30 0.00 0.09 94.68 12:51:01 AM 0 5.88 0.00 0.38 0.00 0.09 93.66 12:51:01 AM 1 4.02 0.00 0.22 0.00 0.08 95.68 12:52:01 AM all 5.47 0.00 1.55 0.00 0.07 92.92 12:52:01 AM 0 7.76 0.00 2.48 0.00 0.07 89.68 12:52:01 AM 1 3.30 0.00 0.67 0.00 0.07 95.96 12:53:01 AM all 5.02 0.00 1.08 0.00 0.07 93.83 12:53:01 AM 0 3.97 0.00 0.42 0.00 0.07 95.54 12:53:01 AM 1 6.09 0.00 1.76 0.00 0.07 92.08 12:54:01 AM all 4.28 0.00 0.19 0.00 0.09 95.43 12:54:01 AM 0 5.40 0.00 0.18 0.00 0.08 94.34 12:54:01 AM 1 3.18 0.00 0.20 0.00 0.10 96.52 12:54:01 AM CPU %user %nice %system %iowait %steal %idle 12:55:01 AM all 4.23 0.00 0.18 0.01 0.08 95.51 12:55:01 AM 0 6.74 0.00 0.22 0.02 0.08 92.94 12:55:01 AM 1 1.72 0.00 0.13 0.00 0.07 98.08 12:56:01 AM all 4.33 0.00 0.18 0.00 0.08 95.41 12:56:01 AM 0 5.26 0.00 0.15 0.00 0.08 94.51 12:56:01 AM 1 3.40 0.00 0.22 0.00 0.07 96.32 12:57:01 AM all 4.22 0.00 0.18 0.00 0.05 95.55 12:57:01 AM 0 3.46 0.00 0.17 0.00 0.05 96.32 12:57:01 AM 1 4.97 0.00 0.20 0.00 0.05 94.78 12:58:01 AM all 4.05 0.00 0.20 0.00 0.08 95.66 12:58:01 AM 0 3.55 0.00 0.20 0.00 0.08 96.17 12:58:01 AM 1 4.56 0.00 0.20 0.00 0.08 95.16 12:59:01 AM all 5.61 0.00 1.30 0.00 0.05 93.04 12:59:01 AM 0 5.61 0.00 0.32 0.00 0.05 94.02 12:59:01 AM 1 5.61 0.00 2.29 0.00 0.05 92.04 01:00:01 AM all 6.72 0.00 2.32 0.02 0.07 90.87 01:00:01 AM 0 3.68 0.00 4.04 0.02 0.07 92.20 01:00:01 AM 1 9.84 0.00 0.56 0.02 0.07 89.51 01:01:01 AM all 4.95 0.00 0.38 0.00 0.08 94.60 01:01:01 AM 0 6.48 0.00 0.47 0.00 0.08 92.97 01:01:01 AM 1 3.43 0.00 0.28 0.00 0.07 96.22 01:02:01 AM all 3.96 0.00 0.31 0.00 0.06 95.68 01:02:01 AM 0 5.22 0.00 0.38 0.00 0.07 94.33 01:02:01 AM 1 2.69 0.00 0.23 0.00 0.05 97.02 01:03:01 AM all 4.19 0.00 0.27 0.00 0.08 95.47 01:03:01 AM 0 7.30 0.00 0.40 0.00 0.08 92.21 01:03:01 AM 1 1.09 0.00 0.13 0.00 0.07 98.71 01:04:01 AM all 4.29 0.00 0.29 0.00 0.08 95.34 01:04:01 AM 0 5.97 0.00 0.37 0.00 0.08 93.58 01:04:01 AM 1 2.63 0.00 0.22 0.00 0.07 97.09 01:05:01 AM all 4.20 0.00 0.33 0.03 0.08 95.37 01:05:01 AM 0 5.04 0.00 0.35 0.00 0.08 94.52 01:05:01 AM 1 3.36 0.00 0.30 0.05 0.07 96.22 01:05:01 AM CPU %user %nice %system %iowait %steal %idle 01:06:01 AM all 4.28 0.00 0.32 0.00 0.06 95.34 01:06:01 AM 0 5.78 0.00 0.40 0.00 0.07 93.75 01:06:01 AM 1 2.79 0.00 0.23 0.00 0.05 96.92 01:07:01 AM all 4.85 0.00 0.26 0.00 0.08 94.82 01:07:01 AM 0 6.91 0.00 0.28 0.00 0.08 92.72 01:07:01 AM 1 2.79 0.00 0.23 0.00 0.07 96.91 01:08:01 AM all 0.38 0.00 0.08 0.00 0.03 99.52 01:08:01 AM 0 0.37 0.00 0.07 0.00 0.03 99.53 01:08:01 AM 1 0.38 0.00 0.08 0.00 0.03 99.50 01:09:01 AM all 0.27 0.00 0.09 0.00 0.03 99.61 01:09:01 AM 0 0.12 0.00 0.07 0.00 0.02 99.80 01:09:01 AM 1 0.42 0.00 0.12 0.00 0.05 99.41 01:10:01 AM all 0.49 0.00 0.08 0.08 0.05 99.30 01:10:01 AM 0 0.42 0.00 0.08 0.00 0.05 99.45 01:10:01 AM 1 0.57 0.00 0.07 0.17 0.05 99.15 01:11:01 AM all 0.39 0.00 0.08 0.00 0.04 99.49 01:11:01 AM 0 0.18 0.00 0.07 0.00 0.03 99.72 01:11:01 AM 1 0.60 0.00 0.08 0.00 0.05 99.26 01:12:01 AM all 0.51 0.00 0.08 0.00 0.05 99.37 01:12:01 AM 0 0.42 0.00 0.07 0.00 0.05 99.47 01:12:01 AM 1 0.60 0.00 0.08 0.00 0.05 99.27 01:13:01 AM all 0.31 0.00 0.06 0.00 0.04 99.59 01:13:01 AM 0 0.10 0.00 0.08 0.00 0.07 99.75 01:13:01 AM 1 0.52 0.00 0.03 0.00 0.02 99.43 01:14:01 AM all 4.60 0.00 0.32 0.00 0.05 95.02 01:14:01 AM 0 4.56 0.00 0.29 0.00 0.07 95.08 01:14:01 AM 1 4.65 0.00 0.36 0.00 0.03 94.96 01:15:01 AM all 6.62 0.00 3.80 0.00 0.06 89.52 01:15:01 AM 0 5.34 0.00 2.34 0.00 0.07 92.24 01:15:01 AM 1 7.92 0.00 5.28 0.00 0.05 86.75 01:16:01 AM all 0.71 0.00 0.10 0.00 0.05 99.14 01:16:01 AM 0 0.82 0.00 0.13 0.00 0.03 99.01 01:16:01 AM 1 0.60 0.00 0.07 0.00 0.07 99.27 01:16:01 AM CPU %user %nice %system %iowait %steal %idle 01:17:01 AM all 0.36 0.00 0.07 0.00 0.05 99.52 01:17:01 AM 0 0.08 0.00 0.07 0.00 0.05 99.80 01:17:01 AM 1 0.63 0.00 0.07 0.00 0.05 99.25 01:18:01 AM all 6.08 0.00 1.37 0.00 0.07 92.48 01:18:01 AM 0 11.56 0.00 2.64 0.00 0.07 85.74 01:18:01 AM 1 0.92 0.00 0.17 0.00 0.07 98.85 01:19:01 AM all 4.15 0.00 0.18 0.00 0.08 95.60 01:19:01 AM 0 6.23 0.00 0.20 0.00 0.08 93.49 01:19:01 AM 1 2.07 0.00 0.15 0.00 0.07 97.71 01:20:01 AM all 4.20 0.00 0.18 0.00 0.07 95.55 01:20:01 AM 0 4.35 0.00 0.18 0.00 0.07 95.40 01:20:01 AM 1 4.05 0.00 0.18 0.00 0.07 95.70 01:21:01 AM all 4.34 0.00 0.18 0.01 0.07 95.40 01:21:01 AM 0 3.71 0.00 0.15 0.00 0.07 96.07 01:21:01 AM 1 4.97 0.00 0.22 0.02 0.07 94.73 01:22:01 AM all 3.97 0.00 0.19 0.00 0.07 95.77 01:22:01 AM 0 1.10 0.00 0.15 0.00 0.05 98.70 01:22:01 AM 1 6.85 0.00 0.23 0.00 0.08 92.83 01:23:01 AM all 4.32 0.00 0.19 0.00 0.06 95.43 01:23:01 AM 0 5.98 0.00 0.25 0.00 0.07 93.70 01:23:01 AM 1 2.66 0.00 0.13 0.00 0.05 97.16 01:24:01 AM all 4.46 0.00 0.22 0.00 0.08 95.25 01:24:01 AM 0 4.15 0.00 0.20 0.00 0.08 95.56 01:24:01 AM 1 4.76 0.00 0.23 0.00 0.07 94.94 01:25:01 AM all 7.19 0.00 1.60 0.00 0.05 91.15 01:25:01 AM 0 7.86 0.00 1.78 0.00 0.05 90.31 01:25:01 AM 1 6.53 0.00 1.43 0.00 0.05 91.99 01:26:01 AM all 6.88 0.00 2.63 0.00 0.08 90.41 01:26:01 AM 0 2.12 0.00 0.15 0.00 0.07 97.66 01:26:01 AM 1 11.98 0.00 5.28 0.00 0.09 82.64 01:27:01 AM all 4.37 0.00 0.33 0.00 0.07 95.23 01:27:01 AM 0 4.27 0.00 0.33 0.00 0.07 95.33 01:27:01 AM 1 4.48 0.00 0.34 0.00 0.07 95.12 01:27:01 AM CPU %user %nice %system %iowait %steal %idle 01:28:01 AM all 4.04 0.00 0.31 0.00 0.06 95.59 01:28:01 AM 0 4.08 0.00 0.33 0.00 0.07 95.52 01:28:01 AM 1 4.01 0.00 0.29 0.00 0.05 95.66 01:29:01 AM all 4.22 0.00 0.32 0.00 0.07 95.40 01:29:01 AM 0 7.13 0.00 0.49 0.00 0.08 92.30 01:29:01 AM 1 1.30 0.00 0.15 0.00 0.05 98.49 01:30:01 AM all 4.33 0.00 0.30 0.00 0.07 95.31 01:30:01 AM 0 3.38 0.00 0.25 0.00 0.05 96.32 01:30:01 AM 1 5.27 0.00 0.35 0.00 0.08 94.29 01:31:02 AM all 4.35 0.00 0.32 0.00 0.07 95.27 01:31:02 AM 0 3.84 0.00 0.28 0.00 0.07 95.80 01:31:02 AM 1 4.85 0.00 0.35 0.00 0.07 94.73 01:32:01 AM all 4.15 0.00 0.33 0.00 0.06 95.46 01:32:01 AM 0 3.69 0.00 0.27 0.00 0.05 95.99 01:32:01 AM 1 4.60 0.00 0.39 0.00 0.07 94.94 01:33:01 AM all 4.57 0.00 0.21 0.00 0.06 95.16 01:33:01 AM 0 6.44 0.00 0.22 0.00 0.07 93.28 01:33:01 AM 1 2.70 0.00 0.20 0.00 0.05 97.05 01:34:01 AM all 0.33 0.00 0.05 0.00 0.03 99.58 01:34:01 AM 0 0.10 0.00 0.05 0.00 0.03 99.82 01:34:01 AM 1 0.57 0.00 0.05 0.00 0.03 99.35 01:35:01 AM all 0.33 0.00 0.06 0.00 0.03 99.58 01:35:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75 01:35:01 AM 1 0.53 0.00 0.03 0.00 0.02 99.42 01:36:01 AM all 0.50 0.00 0.08 0.00 0.04 99.38 01:36:01 AM 0 0.35 0.00 0.07 0.00 0.03 99.55 01:36:01 AM 1 0.65 0.00 0.08 0.00 0.05 99.22 01:37:01 AM all 0.31 0.00 0.07 0.00 0.03 99.59 01:37:01 AM 0 0.05 0.00 0.05 0.00 0.02 99.88 01:37:01 AM 1 0.57 0.00 0.08 0.00 0.05 99.30 01:38:01 AM all 0.37 0.00 0.07 0.00 0.04 99.52 01:38:01 AM 0 0.33 0.00 0.05 0.00 0.03 99.58 01:38:01 AM 1 0.40 0.00 0.08 0.00 0.05 99.46 01:38:01 AM CPU %user %nice %system %iowait %steal %idle 01:39:01 AM all 0.33 0.00 0.06 0.00 0.03 99.58 01:39:01 AM 0 0.07 0.00 0.05 0.00 0.03 99.85 01:39:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32 01:40:01 AM all 4.11 0.00 0.25 0.01 0.05 95.58 01:40:01 AM 0 2.05 0.00 0.13 0.02 0.05 97.75 01:40:01 AM 1 6.24 0.00 0.36 0.00 0.05 93.34 01:41:01 AM all 6.41 0.00 3.37 0.00 0.06 90.15 01:41:01 AM 0 0.62 0.00 0.17 0.00 0.05 99.17 01:41:01 AM 1 12.83 0.00 6.92 0.00 0.07 80.18 01:42:01 AM all 0.93 0.00 0.11 0.00 0.05 98.92 01:42:01 AM 0 0.55 0.00 0.08 0.00 0.07 99.30 01:42:01 AM 1 1.30 0.00 0.14 0.00 0.03 98.53 01:43:01 AM all 0.28 0.00 0.08 0.00 0.04 99.60 01:43:01 AM 0 0.17 0.00 0.12 0.00 0.07 99.65 01:43:01 AM 1 0.40 0.00 0.03 0.00 0.02 99.55 01:44:01 AM all 0.51 0.00 0.08 0.00 0.04 99.37 01:44:01 AM 0 0.18 0.00 0.13 0.00 0.07 99.62 01:44:01 AM 1 0.83 0.00 0.03 0.00 0.02 99.12 01:45:01 AM all 0.36 0.00 0.07 0.00 0.03 99.54 01:45:01 AM 0 0.18 0.00 0.12 0.00 0.05 99.65 01:45:01 AM 1 0.53 0.00 0.02 0.00 0.02 99.43 01:46:01 AM all 0.48 0.00 0.07 0.00 0.04 99.41 01:46:01 AM 0 0.17 0.00 0.08 0.00 0.05 99.70 01:46:01 AM 1 0.80 0.00 0.05 0.00 0.03 99.12 01:47:01 AM all 0.38 0.00 0.06 0.00 0.03 99.53 01:47:01 AM 0 0.15 0.00 0.10 0.00 0.05 99.70 01:47:01 AM 1 0.60 0.00 0.02 0.00 0.02 99.37 01:48:01 AM all 0.41 0.17 0.16 0.00 0.05 99.22 01:48:01 AM 0 0.15 0.33 0.22 0.00 0.07 99.23 01:48:01 AM 1 0.67 0.00 0.10 0.00 0.03 99.20 01:49:01 AM all 0.28 0.00 0.07 0.00 0.04 99.61 01:49:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 01:49:01 AM 1 0.45 0.00 0.07 0.00 0.05 99.43 01:49:01 AM CPU %user %nice %system %iowait %steal %idle 01:50:01 AM all 0.48 0.00 0.08 0.00 0.04 99.41 01:50:01 AM 0 0.45 0.00 0.08 0.00 0.05 99.42 01:50:01 AM 1 0.50 0.00 0.07 0.00 0.03 99.40 01:51:01 AM all 0.36 0.00 0.08 0.00 0.03 99.53 01:51:01 AM 0 0.23 0.00 0.07 0.00 0.02 99.68 01:51:01 AM 1 0.48 0.00 0.08 0.00 0.05 99.38 01:52:01 AM all 0.48 0.00 0.07 0.00 0.05 99.40 01:52:01 AM 0 0.33 0.00 0.08 0.00 0.05 99.53 01:52:01 AM 1 0.63 0.00 0.05 0.00 0.05 99.27 01:53:01 AM all 0.37 0.00 0.07 0.00 0.04 99.52 01:53:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 01:53:01 AM 1 0.62 0.00 0.07 0.00 0.05 99.27 01:54:01 AM all 0.42 0.00 0.08 0.00 0.03 99.47 01:54:01 AM 0 0.35 0.00 0.08 0.00 0.02 99.55 01:54:01 AM 1 0.48 0.00 0.08 0.00 0.03 99.40 01:55:01 AM all 0.22 0.00 0.08 0.00 0.05 99.66 01:55:01 AM 0 0.07 0.00 0.03 0.00 0.03 99.87 01:55:01 AM 1 0.37 0.00 0.12 0.00 0.07 99.45 01:56:01 AM all 2.22 0.00 0.18 0.00 0.05 97.55 01:56:01 AM 0 3.83 0.00 0.27 0.00 0.05 95.85 01:56:01 AM 1 0.65 0.00 0.08 0.00 0.05 99.22 01:57:01 AM all 5.76 0.00 1.61 0.00 0.07 92.56 01:57:01 AM 0 7.32 0.00 3.03 0.00 0.05 89.59 01:57:01 AM 1 4.25 0.00 0.23 0.00 0.08 95.44 01:58:01 AM all 4.24 0.00 0.18 0.00 0.07 95.52 01:58:01 AM 0 1.65 0.00 0.13 0.00 0.07 98.15 01:58:01 AM 1 6.84 0.00 0.22 0.00 0.07 92.88 01:59:01 AM all 4.24 0.00 0.18 0.00 0.08 95.49 01:59:01 AM 0 4.30 0.00 0.20 0.00 0.08 95.42 01:59:01 AM 1 4.18 0.00 0.17 0.00 0.08 95.57 02:00:01 AM all 4.32 0.00 0.20 0.00 0.06 95.42 02:00:01 AM 0 1.64 0.00 0.18 0.00 0.05 98.13 02:00:01 AM 1 7.02 0.00 0.22 0.00 0.07 92.70 02:00:01 AM CPU %user %nice %system %iowait %steal %idle 02:01:01 AM all 4.20 0.00 0.18 0.00 0.08 95.54 02:01:01 AM 0 4.58 0.00 0.17 0.00 0.08 95.17 02:01:01 AM 1 3.81 0.00 0.20 0.00 0.07 95.92 02:02:01 AM all 4.28 0.00 0.19 0.00 0.08 95.45 02:02:01 AM 0 7.28 0.00 0.22 0.00 0.08 92.42 02:02:01 AM 1 1.29 0.00 0.17 0.00 0.07 98.48 02:03:01 AM all 5.42 0.00 0.29 0.00 0.07 94.22 02:03:01 AM 0 3.38 0.00 0.17 0.00 0.07 96.39 02:03:01 AM 1 7.54 0.00 0.42 0.00 0.07 91.97 02:04:01 AM all 4.35 0.00 1.51 0.00 0.04 94.10 02:04:01 AM 0 0.60 0.00 0.08 0.00 0.05 99.27 02:04:01 AM 1 8.27 0.00 3.01 0.00 0.03 88.68 02:05:01 AM all 0.34 0.00 0.08 0.00 0.04 99.53 02:05:01 AM 0 0.58 0.00 0.07 0.00 0.03 99.32 02:05:01 AM 1 0.10 0.00 0.10 0.00 0.05 99.75 02:06:01 AM all 0.46 0.00 0.07 0.00 0.03 99.44 02:06:01 AM 0 0.58 0.00 0.07 0.00 0.03 99.32 02:06:01 AM 1 0.33 0.00 0.07 0.00 0.03 99.57 02:07:01 AM all 0.28 0.00 0.06 0.00 0.05 99.62 02:07:01 AM 0 0.50 0.00 0.10 0.00 0.05 99.35 02:07:01 AM 1 0.05 0.00 0.02 0.00 0.05 99.88 02:08:01 AM all 0.30 0.00 0.08 0.00 0.03 99.59 02:08:01 AM 0 0.22 0.00 0.08 0.00 0.05 99.65 02:08:01 AM 1 0.38 0.00 0.07 0.00 0.02 99.53 02:09:01 AM all 0.33 0.00 0.04 0.00 0.04 99.58 02:09:01 AM 0 0.60 0.00 0.05 0.00 0.05 99.30 02:09:01 AM 1 0.07 0.00 0.03 0.00 0.03 99.87 02:10:01 AM all 0.45 0.00 0.08 0.00 0.04 99.43 02:10:01 AM 0 0.58 0.00 0.07 0.00 0.05 99.30 02:10:01 AM 1 0.32 0.00 0.08 0.00 0.03 99.57 02:11:01 AM all 0.35 0.00 0.05 0.01 0.03 99.56 02:11:01 AM 0 0.63 0.00 0.07 0.00 0.05 99.25 02:11:01 AM 1 0.07 0.00 0.03 0.02 0.02 99.87 02:11:01 AM CPU %user %nice %system %iowait %steal %idle 02:12:01 AM all 0.42 0.00 0.08 0.00 0.03 99.47 02:12:01 AM 0 0.60 0.00 0.13 0.00 0.05 99.21 02:12:01 AM 1 0.23 0.00 0.03 0.00 0.02 99.72 02:13:01 AM all 0.27 0.00 0.07 0.00 0.05 99.62 02:13:01 AM 0 0.12 0.00 0.07 0.00 0.05 99.77 02:13:01 AM 1 0.42 0.00 0.07 0.00 0.05 99.47 02:14:01 AM all 0.16 0.00 0.08 0.00 0.03 99.73 02:14:01 AM 0 0.27 0.00 0.10 0.00 0.03 99.60 02:14:01 AM 1 0.05 0.00 0.05 0.00 0.03 99.87 02:15:01 AM all 0.42 0.00 0.06 0.00 0.03 99.50 02:15:01 AM 0 0.70 0.00 0.07 0.00 0.02 99.22 02:15:01 AM 1 0.13 0.00 0.05 0.00 0.03 99.78 02:16:01 AM all 0.36 0.00 0.04 0.00 0.03 99.57 02:16:01 AM 0 0.58 0.00 0.05 0.00 0.03 99.33 02:16:01 AM 1 0.13 0.00 0.03 0.00 0.03 99.80 02:17:01 AM all 6.32 0.00 1.66 0.00 0.09 91.94 02:17:01 AM 0 9.70 0.00 3.15 0.00 0.09 87.07 02:17:01 AM 1 3.09 0.00 0.24 0.00 0.08 96.59 02:18:01 AM all 4.34 0.00 0.19 0.00 0.05 95.42 02:18:01 AM 0 5.05 0.00 0.18 0.00 0.05 94.71 02:18:01 AM 1 3.62 0.00 0.20 0.00 0.05 96.13 02:19:01 AM all 4.09 0.00 0.18 0.00 0.10 95.63 02:19:01 AM 0 2.69 0.00 0.15 0.00 0.05 97.11 02:19:01 AM 1 5.49 0.00 0.22 0.00 0.15 94.15 02:20:01 AM all 4.16 0.00 0.20 0.00 0.05 95.59 02:20:01 AM 0 3.82 0.00 0.20 0.00 0.05 95.93 02:20:01 AM 1 4.51 0.00 0.20 0.00 0.05 95.24 02:21:01 AM all 4.51 0.00 0.18 0.00 0.07 95.24 02:21:01 AM 0 4.12 0.00 0.17 0.00 0.08 95.63 02:21:01 AM 1 4.91 0.00 0.20 0.00 0.05 94.84 02:22:01 AM all 4.62 0.00 0.20 0.00 0.08 95.10 02:22:01 AM 0 4.06 0.00 0.17 0.00 0.07 95.70 02:22:01 AM 1 5.18 0.00 0.23 0.00 0.08 94.50 02:22:01 AM CPU %user %nice %system %iowait %steal %idle 02:23:01 AM all 4.68 0.00 0.24 0.00 0.07 95.02 02:23:01 AM 0 4.89 0.00 0.25 0.00 0.07 94.79 02:23:01 AM 1 4.47 0.00 0.22 0.00 0.07 95.25 02:24:01 AM all 3.88 0.00 1.38 0.00 0.04 94.69 02:24:01 AM 0 7.80 0.00 2.70 0.00 0.05 89.45 02:24:01 AM 1 0.17 0.00 0.13 0.00 0.03 99.67 02:25:01 AM all 0.31 0.00 0.09 0.00 0.04 99.56 02:25:01 AM 0 0.27 0.00 0.10 0.00 0.05 99.58 02:25:01 AM 1 0.35 0.00 0.08 0.00 0.03 99.53 02:26:01 AM all 0.48 0.00 0.10 0.00 0.03 99.40 02:26:01 AM 0 0.33 0.00 0.08 0.00 0.02 99.57 02:26:01 AM 1 0.62 0.00 0.12 0.00 0.03 99.23 02:27:01 AM all 0.35 0.00 0.07 0.00 0.03 99.55 02:27:01 AM 0 0.12 0.00 0.05 0.00 0.03 99.80 02:27:01 AM 1 0.58 0.00 0.08 0.00 0.03 99.30 02:28:01 AM all 0.47 0.00 0.09 0.00 0.03 99.42 02:28:01 AM 0 0.40 0.00 0.08 0.00 0.02 99.50 02:28:01 AM 1 0.53 0.00 0.10 0.00 0.03 99.33 02:29:01 AM all 0.28 0.00 0.07 0.00 0.04 99.61 02:29:01 AM 0 0.10 0.00 0.08 0.00 0.05 99.77 02:29:01 AM 1 0.47 0.00 0.05 0.00 0.03 99.45 02:30:01 AM all 0.49 0.00 0.08 0.00 0.03 99.39 02:30:01 AM 0 0.60 0.00 0.08 0.00 0.03 99.28 02:30:01 AM 1 0.38 0.00 0.08 0.00 0.03 99.50 02:31:01 AM all 0.28 0.00 0.08 0.00 0.03 99.61 02:31:01 AM 0 0.15 0.00 0.07 0.00 0.03 99.75 02:31:01 AM 1 0.40 0.00 0.10 0.00 0.03 99.46 02:32:01 AM all 0.53 0.00 0.09 0.00 0.03 99.34 02:32:01 AM 0 0.17 0.00 0.08 0.00 0.03 99.72 02:32:01 AM 1 0.90 0.00 0.10 0.00 0.03 98.96 02:33:01 AM all 0.39 0.00 0.08 0.00 0.03 99.50 02:33:01 AM 0 0.17 0.00 0.08 0.00 0.03 99.72 02:33:01 AM 1 0.62 0.00 0.08 0.00 0.02 99.28 02:33:01 AM CPU %user %nice %system %iowait %steal %idle 02:34:01 AM all 0.37 0.00 0.09 0.00 0.04 99.50 02:34:01 AM 0 0.23 0.00 0.07 0.00 0.02 99.68 02:34:01 AM 1 0.50 0.00 0.12 0.00 0.07 99.32 02:35:01 AM all 0.48 0.00 0.09 0.03 0.03 99.37 02:35:01 AM 0 0.55 0.00 0.08 0.07 0.03 99.27 02:35:01 AM 1 0.42 0.00 0.10 0.00 0.02 99.47 02:36:01 AM all 0.30 0.00 0.09 0.05 0.03 99.52 02:36:01 AM 0 0.38 0.00 0.12 0.00 0.03 99.47 02:36:01 AM 1 0.22 0.00 0.07 0.10 0.03 99.58 02:37:01 AM all 6.02 0.00 1.50 0.00 0.08 92.40 02:37:01 AM 0 2.52 0.00 0.59 0.00 0.08 96.81 02:37:01 AM 1 9.73 0.00 2.48 0.00 0.07 87.73 02:38:02 AM all 4.45 0.00 0.27 0.00 0.05 95.23 02:38:02 AM 0 4.49 0.00 0.23 0.00 0.05 95.23 02:38:02 AM 1 4.41 0.00 0.30 0.00 0.05 95.24 02:39:01 AM all 4.95 0.00 0.25 0.00 0.20 94.61 02:39:01 AM 0 5.18 0.00 0.27 0.00 0.17 94.37 02:39:01 AM 1 4.72 0.00 0.22 0.00 0.22 94.84 02:40:01 AM all 5.27 0.00 0.22 0.00 0.10 94.41 02:40:01 AM 0 6.71 0.00 0.22 0.00 0.12 92.96 02:40:01 AM 1 3.83 0.00 0.22 0.00 0.08 95.87 02:41:01 AM all 4.62 0.00 0.21 0.00 0.07 95.10 02:41:01 AM 0 7.24 0.00 0.23 0.00 0.08 92.44 02:41:01 AM 1 2.01 0.00 0.18 0.00 0.05 97.76 02:42:01 AM all 4.45 0.00 0.16 0.00 0.06 95.34 02:42:01 AM 0 5.95 0.00 0.15 0.00 0.07 93.83 02:42:01 AM 1 2.94 0.00 0.17 0.00 0.05 96.84 02:43:01 AM all 4.95 0.00 0.29 0.00 0.06 94.70 02:43:01 AM 0 8.85 0.00 0.37 0.00 0.07 90.71 02:43:01 AM 1 1.09 0.00 0.22 0.00 0.05 98.64 02:44:01 AM all 4.07 0.00 1.54 0.00 0.08 94.32 02:44:01 AM 0 7.77 0.00 3.00 0.00 0.10 89.13 02:44:01 AM 1 0.53 0.00 0.13 0.00 0.05 99.28 02:44:01 AM CPU %user %nice %system %iowait %steal %idle 02:45:01 AM all 0.34 0.00 0.08 0.00 0.03 99.55 02:45:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75 02:45:01 AM 1 0.55 0.00 0.08 0.00 0.02 99.35 02:46:01 AM all 0.52 0.00 0.08 0.00 0.03 99.37 02:46:01 AM 0 0.52 0.00 0.10 0.00 0.02 99.37 02:46:01 AM 1 0.52 0.00 0.07 0.00 0.03 99.38 02:47:01 AM all 0.27 0.00 0.08 0.00 0.03 99.62 02:47:01 AM 0 0.43 0.00 0.08 0.00 0.03 99.45 02:47:01 AM 1 0.10 0.00 0.07 0.00 0.03 99.80 02:48:01 AM all 0.50 0.00 0.09 0.00 0.03 99.37 02:48:01 AM 0 0.42 0.00 0.08 0.00 0.03 99.47 02:48:01 AM 1 0.58 0.00 0.10 0.00 0.03 99.28 02:49:01 AM all 0.28 0.00 0.08 0.00 0.03 99.61 02:49:01 AM 0 0.45 0.00 0.10 0.00 0.05 99.40 02:49:01 AM 1 0.10 0.00 0.07 0.00 0.02 99.82 02:50:01 AM all 0.46 0.00 0.08 0.00 0.03 99.42 02:50:01 AM 0 0.52 0.00 0.05 0.00 0.03 99.40 02:50:01 AM 1 0.40 0.00 0.12 0.00 0.03 99.45 02:51:01 AM all 0.38 0.00 0.08 0.00 0.03 99.52 02:51:01 AM 0 0.20 0.00 0.10 0.00 0.03 99.67 02:51:01 AM 1 0.57 0.00 0.05 0.00 0.02 99.37 02:52:01 AM all 0.45 0.00 0.08 0.00 0.03 99.43 02:52:01 AM 0 0.32 0.00 0.10 0.00 0.05 99.53 02:52:01 AM 1 0.58 0.00 0.07 0.00 0.02 99.33 02:53:01 AM all 0.36 0.00 0.07 0.00 0.05 99.52 02:53:01 AM 0 0.58 0.00 0.05 0.00 0.07 99.30 02:53:01 AM 1 0.13 0.00 0.08 0.00 0.03 99.75 02:54:01 AM all 0.52 0.00 0.10 0.00 0.03 99.35 02:54:01 AM 0 0.92 0.00 0.12 0.00 0.05 98.91 02:54:01 AM 1 0.12 0.00 0.08 0.00 0.02 99.78 02:55:01 AM all 0.38 0.00 0.08 0.01 0.04 99.48 02:55:01 AM 0 0.62 0.00 0.08 0.02 0.03 99.25 02:55:01 AM 1 0.15 0.00 0.08 0.00 0.05 99.72 02:55:01 AM CPU %user %nice %system %iowait %steal %idle 02:56:01 AM all 0.36 0.00 0.08 0.00 0.02 99.54 02:56:01 AM 0 0.55 0.00 0.05 0.00 0.02 99.38 02:56:01 AM 1 0.17 0.00 0.12 0.00 0.02 99.70 02:57:01 AM all 6.05 0.00 2.46 0.00 0.06 91.43 02:57:01 AM 0 4.60 0.00 1.80 0.00 0.05 93.55 02:57:01 AM 1 7.55 0.00 3.16 0.00 0.07 89.22 02:58:01 AM all 5.74 0.00 0.37 0.00 0.16 93.73 02:58:01 AM 0 9.14 0.00 0.50 0.00 0.12 90.24 02:58:01 AM 1 2.36 0.00 0.23 0.00 0.20 97.21 02:59:01 AM all 4.26 0.00 0.30 0.00 0.04 95.40 02:59:01 AM 0 5.35 0.00 0.34 0.00 0.05 94.27 02:59:01 AM 1 3.17 0.00 0.27 0.00 0.03 96.53 03:00:01 AM all 4.45 0.00 0.34 0.02 0.06 95.13 03:00:01 AM 0 5.77 0.00 0.42 0.00 0.05 93.76 03:00:01 AM 1 3.13 0.00 0.27 0.03 0.07 96.50 03:01:01 AM all 4.23 0.00 0.36 0.01 0.07 95.33 03:01:01 AM 0 5.73 0.00 0.49 0.00 0.07 93.72 03:01:01 AM 1 2.74 0.00 0.23 0.02 0.07 96.94 03:02:01 AM all 4.58 0.00 0.33 0.00 0.07 95.03 03:02:01 AM 0 5.76 0.00 0.37 0.00 0.07 93.81 03:02:01 AM 1 3.40 0.00 0.28 0.00 0.07 96.25 03:03:01 AM all 5.03 0.00 0.36 0.00 0.08 94.52 03:03:01 AM 0 7.18 0.00 0.45 0.00 0.07 92.30 03:03:01 AM 1 2.89 0.00 0.27 0.00 0.10 96.74 03:04:01 AM all 4.88 0.00 0.29 0.00 0.07 94.76 03:04:01 AM 0 6.34 0.00 0.28 0.00 0.08 93.29 03:04:01 AM 1 3.43 0.00 0.30 0.00 0.05 96.22 03:05:01 AM all 0.49 0.00 0.07 0.00 0.03 99.41 03:05:01 AM 0 0.53 0.00 0.07 0.00 0.03 99.37 03:05:01 AM 1 0.45 0.00 0.07 0.00 0.03 99.45 03:06:01 AM all 0.34 0.00 0.06 0.00 0.03 99.57 03:06:01 AM 0 0.13 0.00 0.05 0.00 0.03 99.78 03:06:01 AM 1 0.55 0.00 0.07 0.00 0.02 99.37 03:06:01 AM CPU %user %nice %system %iowait %steal %idle 03:07:01 AM all 0.48 0.00 0.10 0.00 0.03 99.39 03:07:01 AM 0 0.78 0.00 0.10 0.00 0.03 99.08 03:07:01 AM 1 0.17 0.00 0.10 0.00 0.03 99.70 03:08:01 AM all 0.30 0.00 0.07 0.00 0.03 99.60 03:08:01 AM 0 0.50 0.00 0.07 0.00 0.03 99.40 03:08:01 AM 1 0.10 0.00 0.07 0.00 0.03 99.80 03:09:01 AM all 0.53 0.00 0.07 0.00 0.03 99.37 03:09:01 AM 0 0.67 0.00 0.05 0.00 0.03 99.25 03:09:01 AM 1 0.40 0.00 0.08 0.00 0.03 99.48 03:10:01 AM all 0.29 0.00 0.08 0.02 0.03 99.59 03:10:01 AM 0 0.47 0.00 0.08 0.03 0.02 99.40 03:10:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 03:11:01 AM all 3.38 0.00 0.28 0.00 0.04 96.30 03:11:01 AM 0 2.81 0.00 0.20 0.00 0.05 96.94 03:11:01 AM 1 3.95 0.00 0.36 0.00 0.03 95.65 03:12:01 AM all 6.66 3.00 3.73 0.41 0.08 86.12 03:12:01 AM 0 3.53 5.01 0.56 0.37 0.07 90.46 03:12:01 AM 1 9.95 0.88 7.08 0.45 0.09 81.56 03:13:01 AM all 1.90 3.19 0.87 0.36 0.04 93.63 03:13:01 AM 0 2.42 6.40 0.53 0.22 0.03 90.39 03:13:01 AM 1 1.38 0.00 1.21 0.51 0.05 96.85 03:14:01 AM all 0.38 0.00 0.08 0.00 0.05 99.49 03:14:01 AM 0 0.35 0.00 0.07 0.00 0.07 99.52 03:14:01 AM 1 0.42 0.00 0.08 0.00 0.03 99.47 03:15:01 AM all 4.60 0.00 1.51 0.00 0.06 93.83 03:15:01 AM 0 1.04 0.00 0.13 0.00 0.05 98.78 03:15:01 AM 1 8.36 0.00 2.97 0.00 0.07 88.60 03:16:01 AM all 4.82 0.00 0.20 0.02 0.07 94.89 03:16:01 AM 0 4.52 0.00 0.18 0.03 0.07 95.19 03:16:01 AM 1 5.12 0.00 0.22 0.00 0.07 94.59 03:17:01 AM all 4.25 0.00 0.18 0.00 0.07 95.51 03:17:01 AM 0 3.69 0.00 0.20 0.00 0.05 96.06 03:17:01 AM 1 4.81 0.00 0.15 0.00 0.08 94.96 03:17:01 AM CPU %user %nice %system %iowait %steal %idle 03:18:01 AM all 4.27 0.00 0.18 0.00 0.07 95.49 03:18:01 AM 0 5.56 0.00 0.18 0.00 0.08 94.17 03:18:01 AM 1 2.98 0.00 0.17 0.00 0.05 96.81 03:19:01 AM all 4.28 0.00 0.19 0.00 0.06 95.47 03:19:01 AM 0 3.30 0.00 0.18 0.00 0.05 96.47 03:19:01 AM 1 5.26 0.00 0.20 0.00 0.07 94.47 03:20:01 AM all 4.19 0.00 0.20 0.31 0.07 95.23 03:20:01 AM 0 3.38 0.00 0.20 0.62 0.05 95.75 03:20:01 AM 1 5.01 0.00 0.20 0.00 0.08 94.70 03:21:01 AM all 4.36 0.00 0.23 0.08 0.10 95.22 03:21:01 AM 0 2.47 0.00 0.17 0.00 0.13 97.23 03:21:01 AM 1 6.27 0.00 0.30 0.17 0.07 93.19 03:22:01 AM all 6.34 0.00 1.45 0.00 0.08 92.13 03:22:01 AM 0 11.89 0.00 2.84 0.00 0.07 85.20 03:22:01 AM 1 1.22 0.00 0.17 0.00 0.08 98.53 03:23:01 AM all 6.92 0.00 1.34 0.00 0.06 91.68 03:23:01 AM 0 13.54 0.00 2.63 0.00 0.07 83.76 03:23:01 AM 1 0.78 0.00 0.15 0.00 0.05 99.02 03:24:01 AM all 4.26 0.00 0.18 0.00 0.08 95.49 03:24:01 AM 0 4.53 0.00 0.18 0.00 0.07 95.22 03:24:01 AM 1 4.00 0.00 0.17 0.00 0.08 95.75 03:25:01 AM all 4.32 0.00 0.18 0.00 0.08 95.43 03:25:01 AM 0 5.09 0.00 0.20 0.00 0.08 94.63 03:25:01 AM 1 3.55 0.00 0.17 0.00 0.07 96.22 03:26:01 AM all 3.98 0.00 0.17 0.00 0.06 95.79 03:26:01 AM 0 6.23 0.00 0.20 0.00 0.07 93.51 03:26:01 AM 1 1.74 0.00 0.13 0.00 0.05 98.08 03:27:01 AM all 4.31 0.00 0.17 0.00 0.07 95.46 03:27:01 AM 0 4.62 0.00 0.17 0.00 0.07 95.15 03:27:01 AM 1 4.00 0.00 0.17 0.00 0.07 95.77 03:28:01 AM all 4.14 0.00 0.20 0.00 0.06 95.60 03:28:01 AM 0 3.78 0.00 0.20 0.00 0.05 95.97 03:28:01 AM 1 4.50 0.00 0.20 0.00 0.07 95.23 03:28:01 AM CPU %user %nice %system %iowait %steal %idle 03:29:01 AM all 4.39 0.00 0.22 0.00 0.07 95.33 03:29:01 AM 0 2.54 0.00 0.15 0.00 0.07 97.24 03:29:01 AM 1 6.26 0.00 0.29 0.00 0.07 93.39 03:30:01 AM all 6.58 0.00 1.37 0.00 0.06 91.99 03:30:01 AM 0 0.48 0.00 0.15 0.00 0.05 99.32 03:30:01 AM 1 13.20 0.00 2.70 0.00 0.07 84.02 03:31:01 AM all 6.01 0.00 2.20 0.01 0.06 91.72 03:31:01 AM 0 0.60 0.00 0.15 0.02 0.05 99.18 03:31:01 AM 1 11.75 0.00 4.37 0.00 0.07 83.81 03:32:01 AM all 4.32 0.00 0.32 0.00 0.07 95.30 03:32:01 AM 0 4.38 0.00 0.33 0.00 0.07 95.22 03:32:01 AM 1 4.25 0.00 0.30 0.00 0.07 95.38 03:33:01 AM all 4.30 0.00 0.26 0.00 0.07 95.37 03:33:01 AM 0 1.96 0.00 0.17 0.00 0.05 97.83 03:33:01 AM 1 6.65 0.00 0.35 0.00 0.08 92.91 03:34:01 AM all 4.25 0.00 0.32 0.00 0.08 95.36 03:34:01 AM 0 5.32 0.00 0.38 0.00 0.08 94.21 03:34:01 AM 1 3.18 0.00 0.25 0.00 0.07 96.50 03:35:01 AM all 4.20 0.00 0.32 0.00 0.06 95.43 03:35:01 AM 0 3.66 0.00 0.27 0.00 0.05 96.02 03:35:01 AM 1 4.74 0.00 0.37 0.00 0.07 94.83 03:36:01 AM all 4.23 0.00 0.29 0.00 0.08 95.40 03:36:01 AM 0 5.30 0.00 0.33 0.00 0.07 94.29 03:36:01 AM 1 3.16 0.00 0.25 0.00 0.08 96.50 03:37:01 AM all 6.60 0.00 0.37 0.00 0.08 92.95 03:37:01 AM 0 10.00 0.00 0.45 0.00 0.08 89.46 03:37:01 AM 1 3.21 0.00 0.28 0.00 0.08 96.42 03:38:01 AM all 0.58 0.00 0.08 0.00 0.06 99.27 03:38:01 AM 0 0.65 0.00 0.07 0.00 0.07 99.22 03:38:01 AM 1 0.52 0.00 0.10 0.00 0.05 99.33 03:39:01 AM all 0.32 0.00 0.08 0.00 0.03 99.57 03:39:01 AM 0 0.52 0.00 0.05 0.00 0.02 99.42 03:39:01 AM 1 0.12 0.00 0.12 0.00 0.03 99.73 03:39:01 AM CPU %user %nice %system %iowait %steal %idle 03:40:01 AM all 0.40 0.00 0.07 0.01 0.05 99.47 03:40:01 AM 0 0.68 0.00 0.08 0.00 0.05 99.18 03:40:01 AM 1 0.12 0.00 0.05 0.02 0.05 99.76 03:41:01 AM all 0.32 0.00 0.07 0.00 0.04 99.57 03:41:01 AM 0 0.52 0.00 0.03 0.00 0.03 99.42 03:41:01 AM 1 0.12 0.00 0.10 0.00 0.05 99.73 03:42:01 AM all 0.34 0.00 0.05 0.00 0.03 99.57 03:42:01 AM 0 0.57 0.00 0.02 0.00 0.02 99.40 03:42:01 AM 1 0.12 0.00 0.08 0.00 0.05 99.75 03:43:01 AM all 0.49 0.00 0.08 0.00 0.04 99.38 03:43:01 AM 0 0.33 0.00 0.08 0.00 0.03 99.55 03:43:01 AM 1 0.65 0.00 0.08 0.00 0.05 99.22 03:44:01 AM all 0.32 0.00 0.06 0.00 0.03 99.59 03:44:01 AM 0 0.08 0.00 0.07 0.00 0.05 99.80 03:44:01 AM 1 0.55 0.00 0.05 0.00 0.02 99.38 03:45:01 AM all 5.76 0.00 5.52 0.00 0.05 88.67 03:45:01 AM 0 10.83 0.00 11.04 0.00 0.03 78.09 03:45:01 AM 1 0.84 0.00 0.15 0.00 0.07 98.95 03:46:01 AM all 5.35 0.00 1.32 0.00 0.06 93.26 03:46:01 AM 0 1.69 0.00 0.24 0.00 0.07 98.01 03:46:01 AM 1 9.22 0.00 2.47 0.00 0.05 88.26 03:47:01 AM all 0.36 0.00 0.06 0.00 0.04 99.54 03:47:01 AM 0 0.10 0.00 0.05 0.00 0.03 99.82 03:47:01 AM 1 0.62 0.00 0.07 0.00 0.05 99.27 03:48:01 AM all 1.15 0.00 0.15 0.00 0.04 98.66 03:48:01 AM 0 1.99 0.00 0.19 0.00 0.05 97.77 03:48:01 AM 1 0.32 0.00 0.12 0.00 0.03 99.53 03:49:01 AM all 6.44 0.00 2.05 0.00 0.08 91.42 03:49:01 AM 0 13.31 0.00 4.15 0.00 0.07 82.47 03:49:01 AM 1 0.20 0.00 0.15 0.00 0.08 99.57 03:50:01 AM all 5.82 0.00 1.68 0.00 0.05 92.45 03:50:01 AM 0 2.68 0.00 0.75 0.00 0.05 96.52 03:50:01 AM 1 9.16 0.00 2.67 0.00 0.05 88.12 03:50:01 AM CPU %user %nice %system %iowait %steal %idle 03:51:01 AM all 6.87 0.00 2.23 0.00 0.06 90.84 03:51:01 AM 0 0.17 0.00 0.18 0.00 0.07 99.58 03:51:01 AM 1 14.13 0.00 4.44 0.00 0.05 81.38 03:52:01 AM all 2.27 0.00 0.60 0.00 0.05 97.08 03:52:01 AM 0 0.17 0.00 0.10 0.00 0.07 99.67 03:52:01 AM 1 4.42 0.00 1.10 0.00 0.03 94.45 03:53:01 AM all 0.36 0.00 0.05 0.00 0.05 99.54 03:53:01 AM 0 0.15 0.00 0.05 0.00 0.07 99.73 03:53:01 AM 1 0.57 0.00 0.05 0.00 0.03 99.35 03:54:01 AM all 4.70 0.00 1.99 0.00 0.06 93.26 03:54:01 AM 0 8.87 0.00 3.96 0.00 0.05 87.12 03:54:01 AM 1 0.77 0.00 0.13 0.00 0.07 99.03 03:55:01 AM all 5.21 0.00 0.82 0.00 0.09 93.87 03:55:01 AM 0 4.60 0.00 1.24 0.00 0.09 94.08 03:55:01 AM 1 5.82 0.00 0.40 0.00 0.10 93.67 03:56:01 AM all 4.21 0.00 0.30 0.00 0.06 95.43 03:56:01 AM 0 4.18 0.00 0.30 0.00 0.07 95.45 03:56:01 AM 1 4.24 0.00 0.30 0.00 0.05 95.41 03:57:01 AM all 4.25 0.00 0.31 0.00 0.07 95.37 03:57:01 AM 0 4.15 0.00 0.30 0.00 0.07 95.48 03:57:01 AM 1 4.35 0.00 0.32 0.00 0.07 95.26 03:58:01 AM all 4.22 0.00 0.31 0.00 0.06 95.42 03:58:01 AM 0 3.33 0.00 0.25 0.00 0.05 96.37 03:58:01 AM 1 5.11 0.00 0.37 0.00 0.07 94.46 03:59:01 AM all 4.23 0.00 0.30 0.00 0.08 95.39 03:59:01 AM 0 2.81 0.00 0.22 0.00 0.07 96.91 03:59:01 AM 1 5.66 0.00 0.38 0.00 0.08 93.87 04:00:01 AM all 4.28 0.00 0.27 0.00 0.07 95.38 04:00:01 AM 0 3.63 0.00 0.22 0.00 0.07 96.09 04:00:01 AM 1 4.94 0.00 0.32 0.00 0.07 94.68 04:01:01 AM all 5.72 0.00 0.31 0.00 0.08 93.89 04:01:01 AM 0 7.37 0.00 0.39 0.00 0.08 92.16 04:01:01 AM 1 4.08 0.00 0.23 0.00 0.07 95.62 04:01:01 AM CPU %user %nice %system %iowait %steal %idle 04:02:01 AM all 0.51 0.00 0.08 0.00 0.04 99.37 04:02:01 AM 0 0.50 0.00 0.08 0.00 0.03 99.38 04:02:01 AM 1 0.52 0.00 0.08 0.00 0.05 99.35 04:03:01 AM all 0.24 0.00 0.07 0.00 0.03 99.66 04:03:01 AM 0 0.07 0.00 0.03 0.00 0.03 99.87 04:03:01 AM 1 0.42 0.00 0.10 0.00 0.03 99.45 04:04:01 AM all 0.49 0.00 0.08 0.00 0.04 99.38 04:04:01 AM 0 0.40 0.00 0.10 0.00 0.05 99.45 04:04:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32 04:05:01 AM all 0.34 0.00 0.06 0.00 0.04 99.56 04:05:01 AM 0 0.58 0.00 0.03 0.00 0.03 99.35 04:05:01 AM 1 0.10 0.00 0.08 0.00 0.05 99.77 04:06:01 AM all 0.50 0.00 0.08 0.00 0.04 99.37 04:06:01 AM 0 0.57 0.00 0.08 0.00 0.03 99.32 04:06:01 AM 1 0.43 0.00 0.08 0.00 0.05 99.43 04:07:01 AM all 0.28 0.00 0.08 0.00 0.03 99.62 04:07:01 AM 0 0.52 0.00 0.10 0.00 0.03 99.35 04:07:01 AM 1 0.03 0.00 0.07 0.00 0.02 99.88 04:08:01 AM all 1.64 0.00 0.10 0.00 0.04 98.22 04:08:01 AM 0 2.21 0.00 0.12 0.00 0.03 97.64 04:08:01 AM 1 1.07 0.00 0.08 0.00 0.05 98.80 04:09:01 AM all 6.56 0.00 5.63 0.00 0.07 87.74 04:09:01 AM 0 10.27 0.00 11.06 0.00 0.07 78.61 04:09:01 AM 1 2.88 0.00 0.24 0.00 0.07 96.81 04:10:01 AM all 3.20 0.00 1.31 0.01 0.05 95.43 04:10:01 AM 0 1.05 0.00 0.12 0.02 0.05 98.77 04:10:01 AM 1 5.46 0.00 2.57 0.00 0.05 91.91 04:11:01 AM all 0.38 0.00 0.07 0.00 0.03 99.52 04:11:01 AM 0 0.20 0.00 0.10 0.00 0.05 99.65 04:11:01 AM 1 0.55 0.00 0.03 0.00 0.02 99.40 04:12:01 AM all 2.53 0.00 0.58 0.00 0.06 96.83 04:12:01 AM 0 4.55 0.00 1.13 0.00 0.07 94.25 04:12:01 AM 1 0.60 0.00 0.05 0.00 0.05 99.30 04:12:01 AM CPU %user %nice %system %iowait %steal %idle 04:13:01 AM all 5.75 0.00 1.89 0.00 0.06 92.30 04:13:01 AM 0 8.60 0.00 2.27 0.00 0.07 89.05 04:13:01 AM 1 3.02 0.00 1.52 0.00 0.05 95.41 04:14:01 AM all 6.64 0.00 1.84 0.00 0.06 91.46 04:14:01 AM 0 13.15 0.00 3.68 0.00 0.05 83.11 04:14:01 AM 1 0.68 0.00 0.15 0.00 0.07 99.10 04:15:01 AM all 6.71 0.00 2.30 0.00 0.06 90.93 04:15:01 AM 0 13.72 0.00 4.63 0.00 0.05 81.59 04:15:01 AM 1 0.25 0.00 0.17 0.00 0.07 99.52 04:16:01 AM all 0.22 0.00 0.06 0.00 0.04 99.68 04:16:01 AM 0 0.03 0.00 0.03 0.00 0.02 99.92 04:16:01 AM 1 0.40 0.00 0.08 0.00 0.07 99.45 04:17:01 AM all 0.37 0.00 0.08 0.00 0.05 99.50 04:17:01 AM 0 0.13 0.00 0.12 0.00 0.05 99.70 04:17:01 AM 1 0.60 0.00 0.05 0.00 0.05 99.30 04:18:01 AM all 6.84 0.00 2.39 0.00 0.06 90.71 04:18:01 AM 0 8.73 0.00 4.49 0.00 0.07 86.71 04:18:01 AM 1 4.99 0.00 0.34 0.00 0.05 94.61 04:19:01 AM all 4.45 0.00 0.31 0.00 0.08 95.17 04:19:01 AM 0 5.80 0.00 0.38 0.00 0.08 93.73 04:19:01 AM 1 3.09 0.00 0.23 0.00 0.07 96.61 04:20:01 AM all 3.92 0.00 0.28 0.00 0.07 95.73 04:20:01 AM 0 5.97 0.00 0.37 0.00 0.07 93.59 04:20:01 AM 1 1.87 0.00 0.18 0.00 0.07 97.88 04:21:01 AM all 4.31 0.00 0.31 0.00 0.07 95.32 04:21:01 AM 0 6.30 0.00 0.44 0.00 0.08 93.18 04:21:01 AM 1 2.32 0.00 0.18 0.00 0.05 97.44 04:22:01 AM all 4.05 0.00 0.29 0.00 0.08 95.58 04:22:01 AM 0 6.23 0.00 0.40 0.00 0.10 93.27 04:22:01 AM 1 1.87 0.00 0.18 0.00 0.05 97.89 04:23:01 AM all 4.22 0.00 0.30 0.00 0.07 95.41 04:23:01 AM 0 5.11 0.00 0.39 0.00 0.07 94.44 04:23:01 AM 1 3.34 0.00 0.22 0.00 0.07 96.37 04:23:01 AM CPU %user %nice %system %iowait %steal %idle 04:24:01 AM all 4.34 0.00 0.29 0.00 0.08 95.29 04:24:01 AM 0 7.17 0.00 0.44 0.00 0.08 92.31 04:24:01 AM 1 1.52 0.00 0.15 0.00 0.07 98.26 04:25:01 AM all 4.55 0.00 0.23 0.00 0.06 95.15 04:25:01 AM 0 6.61 0.00 0.27 0.00 0.05 93.07 04:25:01 AM 1 2.49 0.00 0.20 0.00 0.07 97.24 04:26:01 AM all 0.48 0.00 0.06 0.00 0.04 99.42 04:26:01 AM 0 0.82 0.00 0.03 0.00 0.02 99.13 04:26:01 AM 1 0.15 0.00 0.08 0.00 0.07 99.70 04:27:01 AM all 0.35 0.00 0.06 0.00 0.04 99.55 04:27:01 AM 0 0.57 0.00 0.05 0.00 0.03 99.35 04:27:01 AM 1 0.13 0.00 0.07 0.00 0.05 99.75 04:28:01 AM all 0.50 0.00 0.06 0.00 0.04 99.40 04:28:01 AM 0 0.78 0.00 0.03 0.00 0.03 99.15 04:28:01 AM 1 0.22 0.00 0.08 0.00 0.05 99.65 04:29:01 AM all 0.25 0.00 0.06 0.00 0.03 99.66 04:29:01 AM 0 0.40 0.00 0.03 0.00 0.02 99.55 04:29:01 AM 1 0.10 0.00 0.08 0.00 0.05 99.77 04:30:01 AM all 0.43 0.00 0.08 0.00 0.04 99.44 04:30:01 AM 0 0.47 0.00 0.08 0.00 0.05 99.40 04:30:01 AM 1 0.40 0.00 0.08 0.00 0.03 99.48 04:31:01 AM all 0.34 0.00 0.06 0.00 0.04 99.56 04:31:01 AM 0 0.62 0.00 0.05 0.00 0.03 99.30 04:31:01 AM 1 0.07 0.00 0.07 0.00 0.05 99.82 04:32:01 AM all 2.39 0.00 0.56 0.00 0.05 96.99 04:32:01 AM 0 3.55 0.00 1.02 0.00 0.05 95.38 04:32:01 AM 1 1.25 0.00 0.12 0.00 0.05 98.58 04:33:01 AM all 5.95 0.00 5.64 0.00 0.07 88.35 04:33:01 AM 0 11.57 0.00 11.43 0.00 0.07 76.93 04:33:01 AM 1 0.60 0.00 0.13 0.00 0.07 99.20 04:34:01 AM all 2.47 0.00 0.98 0.00 0.05 96.50 04:34:01 AM 0 4.36 0.00 1.88 0.00 0.03 93.72 04:34:01 AM 1 0.65 0.00 0.10 0.00 0.07 99.18 04:34:01 AM CPU %user %nice %system %iowait %steal %idle 04:35:01 AM all 0.36 0.00 0.07 0.00 0.04 99.53 04:35:01 AM 0 0.15 0.00 0.10 0.00 0.05 99.70 04:35:01 AM 1 0.57 0.00 0.03 0.00 0.03 99.37 04:36:01 AM all 3.91 0.00 1.23 0.00 0.05 94.81 04:36:01 AM 0 7.36 0.00 2.43 0.00 0.05 90.16 04:36:01 AM 1 0.62 0.00 0.08 0.00 0.05 99.25 04:37:01 AM all 0.92 0.00 0.18 0.00 0.07 98.82 04:37:01 AM 0 1.38 0.00 0.20 0.00 0.05 98.37 04:37:01 AM 1 0.47 0.00 0.17 0.00 0.08 99.28 04:38:01 AM all 4.95 0.00 1.22 0.00 0.05 93.77 04:38:01 AM 0 9.66 0.00 2.36 0.00 0.05 87.92 04:38:01 AM 1 0.52 0.00 0.15 0.00 0.05 99.28 04:39:01 AM all 0.35 0.00 0.08 0.00 0.05 99.52 04:39:01 AM 0 0.08 0.00 0.08 0.00 0.05 99.78 04:39:01 AM 1 0.62 0.00 0.07 0.00 0.05 99.27 04:40:01 AM all 1.43 0.00 0.13 0.00 0.04 98.40 04:40:01 AM 0 2.22 0.00 0.17 0.00 0.05 97.56 04:40:01 AM 1 0.65 0.00 0.08 0.00 0.03 99.23 04:41:01 AM all 6.44 0.00 2.37 0.00 0.07 91.13 04:41:01 AM 0 11.95 0.00 4.73 0.00 0.07 83.24 04:41:01 AM 1 1.32 0.00 0.17 0.00 0.07 98.45 04:42:01 AM all 4.19 0.00 0.32 0.00 0.07 95.42 04:42:01 AM 0 6.28 0.00 0.40 0.00 0.08 93.23 04:42:01 AM 1 2.11 0.00 0.23 0.00 0.05 97.61 04:43:01 AM all 4.29 0.00 0.31 0.00 0.08 95.32 04:43:01 AM 0 3.59 0.00 0.28 0.00 0.07 96.06 04:43:01 AM 1 4.99 0.00 0.33 0.00 0.08 94.59 04:44:01 AM all 4.08 0.00 0.31 0.00 0.08 95.53 04:44:01 AM 0 3.90 0.00 0.27 0.00 0.07 95.77 04:44:01 AM 1 4.27 0.00 0.35 0.00 0.08 95.30 04:45:01 AM all 4.15 0.00 0.30 0.00 0.08 95.48 04:45:01 AM 0 3.16 0.00 0.27 0.00 0.07 96.51 04:45:01 AM 1 5.14 0.00 0.33 0.00 0.08 94.44 04:45:01 AM CPU %user %nice %system %iowait %steal %idle 04:46:01 AM all 4.19 0.00 0.31 0.00 0.06 95.44 04:46:01 AM 0 3.18 0.00 0.25 0.00 0.05 96.52 04:46:01 AM 1 5.21 0.00 0.37 0.00 0.07 94.35 04:47:01 AM all 4.53 0.00 0.26 0.00 0.08 95.13 04:47:01 AM 0 4.89 0.00 0.27 0.00 0.08 94.76 04:47:01 AM 1 4.18 0.00 0.25 0.00 0.07 95.50 04:48:01 AM all 4.19 0.00 0.20 0.00 0.07 95.54 04:48:01 AM 0 5.32 0.00 0.25 0.00 0.05 94.38 04:48:01 AM 1 3.06 0.00 0.15 0.00 0.08 96.70 04:49:01 AM all 0.37 0.00 0.05 0.00 0.03 99.55 04:49:01 AM 0 0.57 0.00 0.03 0.00 0.03 99.37 04:49:01 AM 1 0.17 0.00 0.07 0.00 0.03 99.73 04:50:01 AM all 0.32 0.00 0.08 0.00 0.04 99.57 04:50:01 AM 0 0.53 0.00 0.05 0.00 0.03 99.38 04:50:01 AM 1 0.10 0.00 0.10 0.00 0.05 99.75 04:51:02 AM all 0.49 0.00 0.07 0.01 0.04 99.39 04:51:02 AM 0 0.58 0.00 0.05 0.02 0.05 99.30 04:51:02 AM 1 0.40 0.00 0.08 0.00 0.03 99.48 04:52:01 AM all 0.33 0.00 0.06 0.00 0.03 99.58 04:52:01 AM 0 0.54 0.00 0.03 0.00 0.03 99.39 04:52:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.76 04:53:01 AM all 0.51 0.00 0.08 0.00 0.04 99.37 04:53:01 AM 0 0.60 0.00 0.08 0.00 0.05 99.27 04:53:01 AM 1 0.42 0.00 0.08 0.00 0.03 99.47 04:54:01 AM all 0.24 0.00 0.05 0.00 0.03 99.67 04:54:01 AM 0 0.42 0.00 0.07 0.00 0.03 99.48 04:54:01 AM 1 0.07 0.00 0.03 0.00 0.03 99.87 04:55:01 AM all 3.94 0.00 3.75 0.01 0.05 92.25 04:55:01 AM 0 1.37 0.00 0.18 0.00 0.05 98.40 04:55:01 AM 1 6.51 0.00 7.33 0.02 0.05 86.10 04:56:01 AM all 5.98 0.00 4.95 0.00 0.07 88.99 04:56:01 AM 0 3.32 0.00 6.00 0.00 0.07 90.62 04:56:01 AM 1 8.68 0.00 3.90 0.00 0.07 87.36 04:56:01 AM CPU %user %nice %system %iowait %steal %idle 04:57:01 AM all 5.92 0.00 4.75 0.00 0.06 89.27 04:57:01 AM 0 7.00 0.00 0.82 0.00 0.07 92.11 04:57:01 AM 1 4.86 0.00 8.57 0.00 0.05 86.52 04:58:01 AM all 6.03 0.00 5.22 0.00 0.06 88.70 04:58:01 AM 0 9.22 0.00 10.22 0.00 0.05 80.50 04:58:01 AM 1 2.91 0.00 0.34 0.00 0.07 96.68 04:59:01 AM all 6.43 0.00 5.20 0.00 0.06 88.32 04:59:01 AM 0 2.74 0.00 0.47 0.00 0.07 96.72 04:59:01 AM 1 10.27 0.00 10.11 0.00 0.05 79.56 05:00:01 AM all 7.09 0.00 5.03 0.00 0.08 87.80 05:00:01 AM 0 13.68 0.00 10.13 0.00 0.05 76.14 05:00:01 AM 1 0.92 0.00 0.23 0.00 0.10 98.75 05:01:01 AM all 7.02 0.15 5.33 0.00 0.07 87.43 05:01:01 AM 0 11.92 0.31 10.41 0.00 0.07 77.28 05:01:01 AM 1 2.26 0.00 0.40 0.00 0.07 97.27 05:02:01 AM all 14.45 0.00 5.70 0.00 0.07 79.78 05:02:01 AM 0 28.42 0.00 10.87 0.00 0.05 60.66 05:02:01 AM 1 0.75 0.00 0.62 0.00 0.08 98.54 05:03:01 AM all 27.27 0.00 2.93 0.53 0.08 69.18 05:03:01 AM 0 31.37 0.00 2.63 0.22 0.08 65.70 05:03:01 AM 1 23.17 0.00 3.23 0.85 0.08 72.67 Average: all 3.03 0.06 0.60 0.01 0.06 96.25 Average: 0 3.50 0.09 0.72 0.01 0.06 95.62 Average: 1 2.55 0.02 0.47 0.02 0.06 96.88