Started by upstream project "integration-distribution-mri-test-argon" build number 83 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-16223 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-argon [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-2Ny48CheykRz/agent.5280 SSH_AGENT_PID=5281 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-argon@tmp/private_key_6306694390497988423.key (/w/workspace/controller-csit-3node-clustering-tell-all-argon@tmp/private_key_6306694390497988423.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-tell-all-argon/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-argon/test@tmp/jenkins-gitclient-ssh10968510891340602744.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-argon/test@tmp/jenkins-gitclient-ssh15418460783538247290.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 02dd570f7544c8cd6eb17bda775de9bccc89f923 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 02dd570f7544c8cd6eb17bda775de9bccc89f923 # timeout=10 Commit message: "Migrate Get Requests invocations(libraries)" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk c88ead2b4a65ba004398ad07cfe033ae1e467b17 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins11022888628228217668.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-RKtB lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH Generating Requirements File Python 3.11.7 pip 24.0 from /tmp/venv-RKtB/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.3.0 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.34.93 botocore==1.34.93 bs4==0.0.2 cachetools==5.3.3 certifi==2024.2.2 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.6.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.6.1 docker==4.2.2 dogpile.cache==1.3.2 email_validator==2.1.1 filelock==3.13.4 future==1.0.0 gitdb==4.0.11 GitPython==3.1.43 google-auth==2.29.0 httplib2==0.22.0 identify==2.5.36 idna==3.7 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.3 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.21.1 jsonschema-specifications==2023.12.1 keystoneauth1==5.6.0 kubernetes==29.0.0 lftools==0.37.10 lxml==5.2.1 MarkupSafe==2.1.5 msgpack==1.0.8 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.2.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==3.1.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.0.1 oslo.config==9.4.0 oslo.context==5.5.0 oslo.i18n==6.3.0 oslo.log==5.5.1 oslo.serialization==5.4.0 oslo.utils==7.1.0 packaging==24.0 pbr==6.0.0 platformdirs==4.2.1 prettytable==3.10.0 pyasn1==0.6.0 pyasn1_modules==0.4.0 pycparser==2.22 pygerrit2==2.0.15 PyGithub==2.3.0 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.5.0 python-dateutil==2.9.0.post0 python-heatclient==3.5.0 python-jenkins==1.8.2 python-keystoneclient==5.4.0 python-magnumclient==4.4.0 python-novaclient==18.6.0 python-openstackclient==6.6.0 python-swiftclient==4.5.0 PyYAML==6.0.1 referencing==0.35.0 requests==2.31.0 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.18.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.1 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.2.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.4 tqdm==4.66.2 typing_extensions==4.11.0 tzdata==2024.1 urllib3==1.26.18 virtualenv==20.26.0 wcwidth==0.2.13 websocket-client==1.8.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-argon-83 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins14053537776364266368.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' job_name: '41374-83' silo: 'releng' [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins13202080568095571957.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-52TZ + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ awk '{ print $1 }' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 +++ sort -V ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-RKtB + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from file:/tmp/.os_lf_venv + /tmp/venv-RKtB/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-RKtB/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH + PATH=/tmp/venv-RKtB/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 409600 | | totalCoresUsed | 100 | | totalInstancesUsed | 36 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-argon + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-argon-83 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-argon/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-tell-all-argon-83 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2024-04-27T23:07:05Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': 'dac145fa-c641-48d7-b8d5-511882d24db7', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-argon-83/dac145fa-c641-48d7-b8d5-511882d24db7', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-tell-all-argon-83', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}, {'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.171.62', '10.30.170.112', '10.30.171.103']}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': 'dac145fa-c641-48d7-b8d5-511882d24db7', 'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-argon-83', 'job_name': '41374-83', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - ' '20240401-160147.446', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - ' '20230601-180106.003'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': '39e35d0babfd4fa98e048c85d849a978'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-tell-all-argon [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins2024962769328000652.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH SSH not responding on 10.30.170.112. Retrying in 10 seconds... SSH not responding on 10.30.171.103. Retrying in 10 seconds... SSH not responding on 10.30.171.62. Retrying in 10 seconds... Ping to 10.30.171.62 successful. Ping to 10.30.171.103 successful. Ping to 10.30.170.112 successful. SSH not responding on 10.30.171.103. Retrying in 10 seconds... SSH not responding on 10.30.171.62. Retrying in 10 seconds... SSH not responding on 10.30.170.112. Retrying in 10 seconds... Ping to 10.30.171.103 successful. Ping to 10.30.171.62 successful. Ping to 10.30.170.112 successful. SSH not responding on 10.30.171.103. Retrying in 10 seconds... Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. 10.30.170.112 releng-41374-83-0-builder-1.novalocal Successfully copied public keys to slave 10.30.170.112 10.30.171.62 releng-41374-83-0-builder-0.novalocal Successfully copied public keys to slave 10.30.171.62 Process 6700 ready. Process 6701 ready. Ping to 10.30.171.103 successful. SSH not responding on 10.30.171.103. Retrying in 10 seconds... Ping to 10.30.171.103 successful. SSH not responding on 10.30.171.103. Retrying in 10 seconds... Ping to 10.30.171.103 successful. Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. 10.30.171.103 releng-41374-83-0-builder-2.novalocal Successfully copied public keys to slave 10.30.171.103 Process 6702 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins13464224930577693808.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-XpaC lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-argon/.robot_venv lf-activate-venv(): INFO: Installing: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-XpaC/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 9.9 MB/s eta 0:00:00 Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 20.2 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 20.7 MB/s eta 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 10.8 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 62.2 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.13.0/elasticsearch-8.13.0-py3-none-any.whl (451 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.0/451.0 kB 14.4 MB/s eta 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.13.0/elasticsearch_dsl-8.13.0-py3-none-any.whl (88 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.6/88.6 kB 11.3 MB/s eta 0:00:00 Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 5.9 MB/s eta 0:00:00 Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 4.6 MB/s eta 0:00:00 Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 28.2 MB/s eta 0:00:00 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB) Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.7/idna-3.7-py3-none-any.whl (66 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.1/urllib3-2.2.1-py3-none-any.whl (121 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 15.3 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.3.0/robotframework_seleniumlibrary-6.3.0-py2.py3-none-any.whl (97 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.6/97.6 kB 13.1 MB/s eta 0:00:00 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 6.0 MB/s eta 0:00:00 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.0/elastic_transport-8.13.0-py3-none-any.whl (64 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 9.7 MB/s eta 0:00:00 Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 17.3 MB/s eta 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.1/lxml-5.2.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.4.16/regex-2024.4.16-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 14.2 MB/s eta 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 47.7 MB/s eta 0:00:00 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.5/cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.20.0/selenium-4.20.0-py3-none-any.whl (9.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.5/9.5 MB 54.0 MB/s eta 0:00:00 Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 15.3 MB/s eta 0:00:00 Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 7.4 MB/s eta 0:00:00 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.25.0/trio-0.25.0-py3-none-any.whl (467 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.2/467.2 kB 36.3 MB/s eta 0:00:00 Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.11.0/typing_extensions-4.11.0-py3-none-any.whl (34 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB) Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB) Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 6.6 MB/s eta 0:00:00 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55119 sha256=9e4fab636f454a9a8536558db330b034e1060c9794be3ad60d978a745776deb8 Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=7543a7c5542b703d6facb9b430cfe139c5f944af10ad3319989a7bb203d5c688 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf Building wheel for pyhocon (setup.py): started Building wheel for pyhocon (setup.py): finished with status 'done' Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20865 sha256=13eb0a7a72b49455df367462af683e66afc6b38bcc2470c95404ce51384a2da3 Stored in directory: /home/jenkins/.cache/pip/wheels/02/09/4e/04a983205b51f96912ae6fc13f56f3050a586c98200fe36725 Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9953 sha256=341adb738c17edb072a306df74c00f1580a6a7f949bc4480fe9235cef2bba81b Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed Building wheel for scapy (setup.py): started Building wheel for scapy (setup.py): finished with status 'done' Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444327 sha256=a5f3c09c7b00327f158ba6a2f26d8aa41e586b0748be0976a6a996cff5711a58 Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15130 sha256=c6f37c552a266427a175d62b568b0cd24f2f97fd9e25a03193fa080a2f62d94a Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.5 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.0 elasticsearch-8.13.0 elasticsearch-dsl-8.13.0 enum34-1.1.10 h11-0.14.0 idna-3.7 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.2.1 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.4.16 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.3.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.20.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.25.0 trio-websocket-0.11.1 typing_extensions-4.11.0 urllib3-2.2.1 waitress-3.0.0 websocket-client-1.8.0 webtest-3.0.0 wsproto-1.2.0 + pip freeze attrs==23.2.0 bcrypt==4.1.2 beautifulsoup4==4.12.3 certifi==2024.2.2 cffi==1.16.0 charset-normalizer==3.3.2 cryptography==42.0.5 decorator==5.1.1 distlib==0.3.8 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.13.0 elasticsearch==8.13.0 elasticsearch-dsl==8.13.0 enum34==1.1.10 filelock==3.13.4 h11==0.14.0 idna==3.7 ipaddr==2.2.0 isodate==0.6.1 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==2.4 lxml==5.2.1 netaddr==1.2.1 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==3.4.0 platformdirs==4.2.1 ply==3.11 pyang==2.6.0 pyangbind==0.8.5 pycparser==2.22 pyhocon==0.3.60 PyNaCl==1.5.0 pyparsing==3.1.2 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2024.4.16 requests==2.31.0 robotframework==7.0 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.4.1 robotframework-requests==0.9.3 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.3.0 robotframework-sshlibrary==3.8.0 scapy==2.5.0 scp==0.14.5 selenium==4.20.0 six==1.16.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.5 trio==0.25.0 trio-websocket==0.11.1 typing_extensions==4.11.0 urllib3==2.2.1 virtualenv==20.26.0 waitress==3.0.0 WebOb==1.8.7 websocket-client==1.8.0 WebTest==3.0.0 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins7492357515162987773.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-argon-83 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' + for i in "${ADDR[@]}" ++ ssh 10.30.171.62 hostname -s Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. + REMHOST=releng-41374-83-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.112 hostname -s Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + REMHOST=releng-41374-83-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.103 hostname -s Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + REMHOST=releng-41374-83-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.171.62 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.171.62 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.170.112 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.171.103 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.171.62 ODL_SYSTEM_1_IP=10.30.171.62 ODL_SYSTEM_2_IP=10.30.170.112 ODL_SYSTEM_3_IP=10.30.171.103 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/sh /tmp/jenkins9705799192337076262.sh Preparing for JRE Version 17 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-17-openjdk [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins9536264673810787703.sh --2024-04-27 23:09:29-- http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/argon Resolving git.opendaylight.org (git.opendaylight.org)... 13.39.230.180, 52.47.161.242, 35.181.223.58, ... Connecting to git.opendaylight.org (git.opendaylight.org)|13.39.230.180|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 2620 (2.6K) [text/plain] Saving to: ‘pom.xml’ 0K .. 100% 229M=0s 2024-04-27 23:09:29 (229 MB/s) - ‘pom.xml’ saved [2620/2620] Bundle version is 0.18.4-SNAPSHOT --2024-04-27 23:09:29-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 58.3M=0s 2024-04-27 23:09:29 (58.3 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.18.4-SNAPSHOT 20240427.194437 206 20240427194437 pom 0.18.4-20240427.194437-206 20240427194437 tar.gz 0.18.4-20240427.194437-206 20240427194437 zip 0.18.4-20240427.194437-206 20240427194437 cyclonedx xml 0.18.4-20240427.194437-206 20240427194437 cyclonedx json 0.18.4-20240427.194437-206 20240427194437 Nexus timestamp is 0.18.4-20240427.194437-206 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip Distribution bundle is karaf-0.18.4-20240427.194437-206.zip Distribution bundle version is 0.18.4-SNAPSHOT Distribution folder is karaf-0.18.4-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins199234360286031287.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.171.62:/tmp Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.112:/tmp Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.103:/tmp Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins9789143251274688972.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.171.62 Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.170.112 Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.171.103 Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.171.62 Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. common-functions.sh is being sourced + source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp + echo 'Changing to /tmp' + cd /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip --2024-04-27 23:09:40-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 260400398 (248M) [application/zip] Saving to: ‘karaf-0.18.4-20240427.194437-206.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 82.3M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 123M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 154M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 116M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 147M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 184M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 183M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 205M 2s 24576K ........ ........ ........ ........ ........ ........ 10% 97.2M 2s 27648K ........ ........ ........ ........ ........ ........ 12% 244M 2s 30720K ........ ........ ........ ........ ........ ........ 13% 274M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 255M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 288M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 259M 1s 43008K ........ ........ ........ ........ ........ ........ 18% 293M 1s 46080K ........ ........ ........ ........ ........ ........ 19% 296M 1s 49152K ........ ........ ........ ........ ........ ........ 20% 309M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 227M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 248M 1s 58368K ........ ........ ........ ........ ........ ........ 24% 289M 1s 61440K ........ ........ ........ ........ ........ ........ 25% 340M 1s 64512K ........ ........ ........ ........ ........ ........ 26% 292M 1s 67584K ........ ........ ........ ........ ........ ........ 27% 217M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 269M 1s 73728K ........ ........ ........ ........ ........ ........ 30% 305M 1s 76800K ........ ........ ........ ........ ........ ........ 31% 288M 1s 79872K ........ ........ ........ ........ ........ ........ 32% 86.5M 1s 82944K ........ ........ ........ ........ ........ ........ 33% 158M 1s 86016K ........ ........ ........ ........ ........ ........ 35% 271M 1s 89088K ........ ........ ........ ........ ........ ........ 36% 295M 1s 92160K ........ ........ ........ ........ ........ ........ 37% 300M 1s 95232K ........ ........ ........ ........ ........ ........ 38% 251M 1s 98304K ........ ........ ........ ........ ........ ........ 39% 260M 1s 101376K ........ ........ ........ ........ ........ ........ 41% 309M 1s 104448K ........ ........ ........ ........ ........ ........ 42% 290M 1s 107520K ........ ........ ........ ........ ........ ........ 43% 302M 1s 110592K ........ ........ ........ ........ ........ ........ 44% 299M 1s 113664K ........ ........ ........ ........ ........ ........ 45% 291M 1s 116736K ........ ........ ........ ........ ........ ........ 47% 278M 1s 119808K ........ ........ ........ ........ ........ ........ 48% 272M 1s 122880K ........ ........ ........ ........ ........ ........ 49% 278M 1s 125952K ........ ........ ........ ........ ........ ........ 50% 297M 1s 129024K ........ ........ ........ ........ ........ ........ 51% 300M 1s 132096K ........ ........ ........ ........ ........ ........ 53% 294M 1s 135168K ........ ........ ........ ........ ........ ........ 54% 296M 1s 138240K ........ ........ ........ ........ ........ ........ 55% 302M 1s 141312K ........ ........ ........ ........ ........ ........ 56% 297M 0s 144384K ........ ........ ........ ........ ........ ........ 57% 305M 0s 147456K ........ ........ ........ ........ ........ ........ 59% 295M 0s 150528K ........ ........ ........ ........ ........ ........ 60% 281M 0s 153600K ........ ........ ........ ........ ........ ........ 61% 301M 0s 156672K ........ ........ ........ ........ ........ ........ 62% 261M 0s 159744K ........ ........ ........ ........ ........ ........ 64% 301M 0s 162816K ........ ........ ........ ........ ........ ........ 65% 307M 0s 165888K ........ ........ ........ ........ ........ ........ 66% 300M 0s 168960K ........ ........ ........ ........ ........ ........ 67% 303M 0s 172032K ........ ........ ........ ........ ........ ........ 68% 290M 0s 175104K ........ ........ ........ ........ ........ ........ 70% 259M 0s 178176K ........ ........ ........ ........ ........ ........ 71% 244M 0s 181248K ........ ........ ........ ........ ........ ........ 72% 251M 0s 184320K ........ ........ ........ ........ ........ ........ 73% 247M 0s 187392K ........ ........ ........ ........ ........ ........ 74% 248M 0s 190464K ........ ........ ........ ........ ........ ........ 76% 255M 0s 193536K ........ ........ ........ ........ ........ ........ 77% 252M 0s 196608K ........ ........ ........ ........ ........ ........ 78% 246M 0s 199680K ........ ........ ........ ........ ........ ........ 79% 250M 0s 202752K ........ ........ ........ ........ ........ ........ 80% 241M 0s 205824K ........ ........ ........ ........ ........ ........ 82% 252M 0s 208896K ........ ........ ........ ........ ........ ........ 83% 248M 0s 211968K ........ ........ ........ ........ ........ ........ 84% 257M 0s 215040K ........ ........ ........ ........ ........ ........ 85% 238M 0s 218112K ........ ........ ........ ........ ........ ........ 86% 254M 0s 221184K ........ ........ ........ ........ ........ ........ 88% 247M 0s 224256K ........ ........ ........ ........ ........ ........ 89% 250M 0s 227328K ........ ........ ........ ........ ........ ........ 90% 249M 0s 230400K ........ ........ ........ ........ ........ ........ 91% 255M 0s 233472K ........ ........ ........ ........ ........ ........ 93% 248M 0s 236544K ........ ........ ........ ........ ........ ........ 94% 259M 0s 239616K ........ ........ ........ ........ ........ ........ 95% 244M 0s 242688K ........ ........ ........ ........ ........ ........ 96% 254M 0s 245760K ........ ........ ........ ........ ........ ........ 97% 244M 0s 248832K ........ ........ ........ ........ ........ ........ 99% 264M 0s 251904K ........ ........ ........ ........ ..... 100% 266M=1.1s 2024-04-27 23:09:41 (236 MB/s) - ‘karaf-0.18.4-20240427.194437-206.zip’ saved [260400398/260400398] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.18.4-20240427.194437-206.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.18.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/ac4bea03-2537-49af-93bc-7bcf368d2408.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, c056e45f-ecf9-455c-ab15-cc596454e9c5 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: + unset IFS + echo 'controllerdebugmap: ' cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-17-openjdk + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' max memory: 3072m memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.62:33548 199.204.45.87:443 TIME_WAIT - tcp 0 164 10.30.171.62:22 10.30.171.67:53978 ESTABLISHED - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.171.62:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.62 10.30.170.112 10.30.171.103 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.62" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.62:2550", "akka://opendaylight-cluster-data@10.30.170.112:2550", "akka://opendaylight-cluster-data@10.30.171.103:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.170.112 Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' common-functions.sh is being sourced ++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip --2024-04-27 23:09:45-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 260400398 (248M) [application/zip] Saving to: ‘karaf-0.18.4-20240427.194437-206.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 7.24M 34s 3072K ........ ........ ........ ........ ........ ........ 2% 137M 18s 6144K ........ ........ ........ ........ ........ ........ 3% 121M 12s 9216K ........ ........ ........ ........ ........ ........ 4% 187M 9s 12288K ........ ........ ........ ........ ........ ........ 6% 209M 8s 15360K ........ ........ ........ ........ ........ ........ 7% 234M 6s 18432K ........ ........ ........ ........ ........ ........ 8% 241M 6s 21504K ........ ........ ........ ........ ........ ........ 9% 254M 5s 24576K ........ ........ ........ ........ ........ ........ 10% 278M 4s 27648K ........ ........ ........ ........ ........ ........ 12% 302M 4s 30720K ........ ........ ........ ........ ........ ........ 13% 304M 4s 33792K ........ ........ ........ ........ ........ ........ 14% 330M 3s 36864K ........ ........ ........ ........ ........ ........ 15% 326M 3s 39936K ........ ........ ........ ........ ........ ........ 16% 373M 3s 43008K ........ ........ ........ ........ ........ ........ 18% 369M 3s 46080K ........ ........ ........ ........ ........ ........ 19% 351M 3s 49152K ........ ........ ........ ........ ........ ........ 20% 312M 2s 52224K ........ ........ ........ ........ ........ ........ 21% 320M 2s 55296K ........ ........ ........ ........ ........ ........ 22% 363M 2s 58368K ........ ........ ........ ........ ........ ........ 24% 355M 2s 61440K ........ ........ ........ ........ ........ ........ 25% 277M 2s 64512K ........ ........ ........ ........ ........ ........ 26% 296M 2s 67584K ........ ........ ........ ........ ........ ........ 27% 324M 2s 70656K ........ ........ ........ ........ ........ ........ 28% 348M 2s 73728K ........ ........ ........ ........ ........ ........ 30% 327M 2s 76800K ........ ........ ........ ........ ........ ........ 31% 339M 2s 79872K ........ ........ ........ ........ ........ ........ 32% 321M 1s 82944K ........ ........ ........ ........ ........ ........ 33% 362M 1s 86016K ........ ........ ........ ........ ........ ........ 35% 356M 1s 89088K ........ ........ ........ ........ ........ ........ 36% 354M 1s 92160K ........ ........ ........ ........ ........ ........ 37% 351M 1s 95232K ........ ........ ........ ........ ........ ........ 38% 350M 1s 98304K ........ ........ ........ ........ ........ ........ 39% 342M 1s 101376K ........ ........ ........ ........ ........ ........ 41% 356M 1s 104448K ........ ........ ........ ........ ........ ........ 42% 341M 1s 107520K ........ ........ ........ ........ ........ ........ 43% 342M 1s 110592K ........ ........ ........ ........ ........ ........ 44% 354M 1s 113664K ........ ........ ........ ........ ........ ........ 45% 345M 1s 116736K ........ ........ ........ ........ ........ ........ 47% 338M 1s 119808K ........ ........ ........ ........ ........ ........ 48% 348M 1s 122880K ........ ........ ........ ........ ........ ........ 49% 336M 1s 125952K ........ ........ ........ ........ ........ ........ 50% 348M 1s 129024K ........ ........ ........ ........ ........ ........ 51% 338M 1s 132096K ........ ........ ........ ........ ........ ........ 53% 353M 1s 135168K ........ ........ ........ ........ ........ ........ 54% 346M 1s 138240K ........ ........ ........ ........ ........ ........ 55% 292M 1s 141312K ........ ........ ........ ........ ........ ........ 56% 82.1M 1s 144384K ........ ........ ........ ........ ........ ........ 57% 317M 1s 147456K ........ ........ ........ ........ ........ ........ 59% 328M 1s 150528K ........ ........ ........ ........ ........ ........ 60% 329M 1s 153600K ........ ........ ........ ........ ........ ........ 61% 287M 1s 156672K ........ ........ ........ ........ ........ ........ 62% 261M 1s 159744K ........ ........ ........ ........ ........ ........ 64% 302M 1s 162816K ........ ........ ........ ........ ........ ........ 65% 342M 1s 165888K ........ ........ ........ ........ ........ ........ 66% 319M 0s 168960K ........ ........ ........ ........ ........ ........ 67% 317M 0s 172032K ........ ........ ........ ........ ........ ........ 68% 408M 0s 175104K ........ ........ ........ ........ ........ ........ 70% 168M 0s 178176K ........ ........ ........ ........ ........ ........ 71% 176M 0s 181248K ........ ........ ........ ........ ........ ........ 72% 302M 0s 184320K ........ ........ ........ ........ ........ ........ 73% 333M 0s 187392K ........ ........ ........ ........ ........ ........ 74% 349M 0s 190464K ........ ........ ........ ........ ........ ........ 76% 336M 0s 193536K ........ ........ ........ ........ ........ ........ 77% 347M 0s 196608K ........ ........ ........ ........ ........ ........ 78% 343M 0s 199680K ........ ........ ........ ........ ........ ........ 79% 329M 0s 202752K ........ ........ ........ ........ ........ ........ 80% 351M 0s 205824K ........ ........ ........ ........ ........ ........ 82% 344M 0s 208896K ........ ........ ........ ........ ........ ........ 83% 325M 0s 211968K ........ ........ ........ ........ ........ ........ 84% 330M 0s 215040K ........ ........ ........ ........ ........ ........ 85% 328M 0s 218112K ........ ........ ........ ........ ........ ........ 86% 353M 0s 221184K ........ ........ ........ ........ ........ ........ 88% 324M 0s 224256K ........ ........ ........ ........ ........ ........ 89% 353M 0s 227328K ........ ........ ........ ........ ........ ........ 90% 340M 0s 230400K ........ ........ ........ ........ ........ ........ 91% 352M 0s 233472K ........ ........ ........ ........ ........ ........ 93% 342M 0s 236544K ........ ........ ........ ........ ........ ........ 94% 350M 0s 239616K ........ ........ ........ ........ ........ ........ 95% 340M 0s 242688K ........ ........ ........ ........ ........ ........ 96% 354M 0s 245760K ........ ........ ........ ........ ........ ........ 97% 337M 0s 248832K ........ ........ ........ ........ ........ ........ 99% 387M 0s 251904K ........ ........ ........ ........ ..... 100% 393M=1.2s 2024-04-27 23:09:46 (200 MB/s) - ‘karaf-0.18.4-20240427.194437-206.zip’ saved [260400398/260400398] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.18.4-20240427.194437-206.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.18.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/ac4bea03-2537-49af-93bc-7bcf368d2408.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, c056e45f-ecf9-455c-ab15-cc596454e9c5 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' controllerdebugmap: + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true + echo 'Set Java version' Set Java version + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.170.112:55590 199.204.45.87:443 TIME_WAIT - tcp 0 164 10.30.170.112:22 10.30.171.67:55154 ESTABLISHED - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.170.112:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.62 10.30.170.112 10.30.171.103 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.112" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.62:2550", "akka://opendaylight-cluster-data@10.30.170.112:2550", "akka://opendaylight-cluster-data@10.30.171.103:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.171.103 Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.18.4-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' common-functions.sh is being sourced ++ BUNDLEFOLDER=karaf-0.18.4-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip --2024-04-27 23:09:49-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 260400398 (248M) [application/zip] Saving to: ‘karaf-0.18.4-20240427.194437-206.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 78.7M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 128M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 162M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 146M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 198M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 206M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 180M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 232M 1s 24576K ........ ........ ........ ........ ........ ........ 10% 334M 1s 27648K ........ ........ ........ ........ ........ ........ 12% 306M 1s 30720K ........ ........ ........ ........ ........ ........ 13% 248M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 219M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 305M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 325M 1s 43008K ........ ........ ........ ........ ........ ........ 18% 249M 1s 46080K ........ ........ ........ ........ ........ ........ 19% 264M 1s 49152K ........ ........ ........ ........ ........ ........ 20% 287M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 246M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 159M 1s 58368K ........ ........ ........ ........ ........ ........ 24% 219M 1s 61440K ........ ........ ........ ........ ........ ........ 25% 247M 1s 64512K ........ ........ ........ ........ ........ ........ 26% 279M 1s 67584K ........ ........ ........ ........ ........ ........ 27% 212M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 85.7M 1s 73728K ........ ........ ........ ........ ........ ........ 30% 250M 1s 76800K ........ ........ ........ ........ ........ ........ 31% 293M 1s 79872K ........ ........ ........ ........ ........ ........ 32% 306M 1s 82944K ........ ........ ........ ........ ........ ........ 33% 329M 1s 86016K ........ ........ ........ ........ ........ ........ 35% 288M 1s 89088K ........ ........ ........ ........ ........ ........ 36% 276M 1s 92160K ........ ........ ........ ........ ........ ........ 37% 264M 1s 95232K ........ ........ ........ ........ ........ ........ 38% 251M 1s 98304K ........ ........ ........ ........ ........ ........ 39% 300M 1s 101376K ........ ........ ........ ........ ........ ........ 41% 295M 1s 104448K ........ ........ ........ ........ ........ ........ 42% 271M 1s 107520K ........ ........ ........ ........ ........ ........ 43% 285M 1s 110592K ........ ........ ........ ........ ........ ........ 44% 271M 1s 113664K ........ ........ ........ ........ ........ ........ 45% 285M 1s 116736K ........ ........ ........ ........ ........ ........ 47% 245M 1s 119808K ........ ........ ........ ........ ........ ........ 48% 217M 1s 122880K ........ ........ ........ ........ ........ ........ 49% 287M 1s 125952K ........ ........ ........ ........ ........ ........ 50% 85.5M 1s 129024K ........ ........ ........ ........ ........ ........ 51% 344M 1s 132096K ........ ........ ........ ........ ........ ........ 53% 92.8M 1s 135168K ........ ........ ........ ........ ........ ........ 54% 244M 1s 138240K ........ ........ ........ ........ ........ ........ 55% 353M 1s 141312K ........ ........ ........ ........ ........ ........ 56% 309M 1s 144384K ........ ........ ........ ........ ........ ........ 57% 288M 0s 147456K ........ ........ ........ ........ ........ ........ 59% 304M 0s 150528K ........ ........ ........ ........ ........ ........ 60% 327M 0s 153600K ........ ........ ........ ........ ........ ........ 61% 305M 0s 156672K ........ ........ ........ ........ ........ ........ 62% 299M 0s 159744K ........ ........ ........ ........ ........ ........ 64% 253M 0s 162816K ........ ........ ........ ........ ........ ........ 65% 284M 0s 165888K ........ ........ ........ ........ ........ ........ 66% 285M 0s 168960K ........ ........ ........ ........ ........ ........ 67% 306M 0s 172032K ........ ........ ........ ........ ........ ........ 68% 302M 0s 175104K ........ ........ ........ ........ ........ ........ 70% 154M 0s 178176K ........ ........ ........ ........ ........ ........ 71% 227M 0s 181248K ........ ........ ........ ........ ........ ........ 72% 301M 0s 184320K ........ ........ ........ ........ ........ ........ 73% 274M 0s 187392K ........ ........ ........ ........ ........ ........ 74% 303M 0s 190464K ........ ........ ........ ........ ........ ........ 76% 268M 0s 193536K ........ ........ ........ ........ ........ ........ 77% 251M 0s 196608K ........ ........ ........ ........ ........ ........ 78% 290M 0s 199680K ........ ........ ........ ........ ........ ........ 79% 305M 0s 202752K ........ ........ ........ ........ ........ ........ 80% 290M 0s 205824K ........ ........ ........ ........ ........ ........ 82% 296M 0s 208896K ........ ........ ........ ........ ........ ........ 83% 291M 0s 211968K ........ ........ ........ ........ ........ ........ 84% 299M 0s 215040K ........ ........ ........ ........ ........ ........ 85% 289M 0s 218112K ........ ........ ........ ........ ........ ........ 86% 318M 0s 221184K ........ ........ ........ ........ ........ ........ 88% 305M 0s 224256K ........ ........ ........ ........ ........ ........ 89% 310M 0s 227328K ........ ........ ........ ........ ........ ........ 90% 77.8M 0s 230400K ........ ........ ........ ........ ........ ........ 91% 343M 0s 233472K ........ ........ ........ ........ ........ ........ 93% 272M 0s 236544K ........ ........ ........ ........ ........ ........ 94% 107M 0s 239616K ........ ........ ........ ........ ........ ........ 95% 329M 0s 242688K ........ ........ ........ ........ ........ ........ 96% 275M 0s 245760K ........ ........ ........ ........ ........ ........ 97% 328M 0s 248832K ........ ........ ........ ........ ........ ........ 99% 281M 0s 251904K ........ ........ ........ ........ ..... 100% 276M=1.1s 2024-04-27 23:09:51 (228 MB/s) - ‘karaf-0.18.4-20240427.194437-206.zip’ saved [260400398/260400398] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.18.4-20240427.194437-206.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.18.4-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.18.4-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/ac4bea03-2537-49af-93bc-7bcf368d2408.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, c056e45f-ecf9-455c-ab15-cc596454e9c5 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: + unset IFS + echo 'controllerdebugmap: ' cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv Configure java home: /usr/lib/jvm/java-17-openjdk + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' max memory: 3072m memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo ' memconf: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true + echo 'Set Java version' Set Java version + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.103:41464 199.204.45.87:443 TIME_WAIT - tcp 0 0 10.30.171.103:22 10.30.171.67:52434 ESTABLISHED - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.171.103:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - Custom shard config exists!!! Copying the shard config... + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.18.4-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.18.4-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.62 10.30.170.112 10.30.171.103 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.18.4-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/7.0.11 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.103" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.62:2550", "akka://opendaylight-cluster-data@10.30.170.112:2550", "akka://opendaylight-cluster-data@10.30.171.103:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.171.62 Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.170.112 Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.171.103 Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins3440649142722019922.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.18.4-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.18.4-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.18.4-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.18.4-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.171.62' Execute the post startup script on controller 10.30.171.62 + scp /w/workspace/controller-csit-3node-clustering-tell-all-argon/post-startup-script.sh 10.30.171.62:/tmp/ Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. + ssh 10.30.171.62 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-27T23:10:47,530 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-27T23:10:47,530 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.62:22 10.30.171.67:35356 ESTABLISHED - tcp6 0 0 :::6633 :::* LISTEN 5741/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5741/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5741/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5741/java tcp6 0 0 10.30.171.62:2550 :::* LISTEN 5741/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5741/java tcp6 0 0 :::6653 :::* LISTEN 5741/java tcp6 0 0 :::4189 :::* LISTEN 5741/java tcp6 0 0 127.0.0.1:43037 :::* LISTEN 5741/java tcp6 0 0 :::1790 :::* LISTEN 5741/java tcp6 0 0 :::8101 :::* LISTEN 5741/java tcp6 0 0 10.30.171.62:2550 10.30.170.112:37324 ESTABLISHED 5741/java tcp6 0 0 10.30.171.62:50100 10.30.171.103:2550 ESTABLISHED 5741/java tcp6 32 0 10.30.171.62:52474 199.204.45.87:443 CLOSE_WAIT 5741/java tcp6 0 0 127.0.0.1:34256 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.62:2550 10.30.171.103:52372 ESTABLISHED 5741/java tcp6 0 0 10.30.171.62:50112 10.30.171.103:2550 ESTABLISHED 5741/java tcp6 0 0 127.0.0.1:36436 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 127.0.0.1:36432 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.62:49442 10.30.170.112:2550 ESTABLISHED 5741/java tcp6 0 0 10.30.171.62:49456 10.30.170.112:2550 ESTABLISHED 5741/java tcp6 0 0 10.30.171.62:2550 10.30.171.103:52376 ESTABLISHED 5741/java tcp6 0 0 10.30.171.62:2550 10.30.170.112:37318 ESTABLISHED 5741/java udp 0 0 10.30.171.62:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5741/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.170.112' Execute the post startup script on controller 10.30.170.112 + scp /w/workspace/controller-csit-3node-clustering-tell-all-argon/post-startup-script.sh 10.30.170.112:/tmp/ Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + ssh 10.30.170.112 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-27T23:10:48,161 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-27T23:10:48,161 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.112:22 10.30.171.67:56800 ESTABLISHED - tcp6 0 0 127.0.0.1:38479 :::* LISTEN 5742/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5742/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5742/java tcp6 0 0 10.30.170.112:2550 :::* LISTEN 5742/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::12345 :::* LISTEN 5742/java tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5742/java tcp6 0 0 :::6653 :::* LISTEN 5742/java tcp6 0 0 :::1790 :::* LISTEN 5742/java tcp6 0 0 :::8101 :::* LISTEN 5742/java tcp6 0 0 :::6633 :::* LISTEN 5742/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5742/java tcp6 0 0 127.0.0.1:43642 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 127.0.0.1:57072 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.170.112:50882 10.30.171.103:2550 ESTABLISHED 5742/java tcp6 0 0 10.30.170.112:37324 10.30.171.62:2550 ESTABLISHED 5742/java tcp6 0 0 10.30.170.112:2550 10.30.171.62:49442 ESTABLISHED 5742/java tcp6 0 0 10.30.170.112:50894 10.30.171.103:2550 ESTABLISHED 5742/java tcp6 0 0 10.30.170.112:2550 10.30.171.103:51020 ESTABLISHED 5742/java tcp6 32 0 10.30.170.112:33252 199.204.45.87:443 CLOSE_WAIT 5742/java tcp6 0 0 127.0.0.1:58478 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.112:2550 10.30.171.62:49456 ESTABLISHED 5742/java tcp6 0 0 10.30.170.112:2550 10.30.171.103:51006 ESTABLISHED 5742/java tcp6 0 0 10.30.170.112:37318 10.30.171.62:2550 ESTABLISHED 5742/java udp 0 0 10.30.170.112:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5742/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.171.103' Execute the post startup script on controller 10.30.171.103 + scp /w/workspace/controller-csit-3node-clustering-tell-all-argon/post-startup-script.sh 10.30.171.103:/tmp/ Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + ssh 10.30.171.103 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-27T23:10:46,589 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-27T23:10:46,589 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 301 - org.opendaylight.infrautils.ready-api - 5.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.171.103:22 10.30.171.67:52520 ESTABLISHED - tcp6 0 0 :::8101 :::* LISTEN 5765/java tcp6 0 0 :::6633 :::* LISTEN 5765/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5765/java tcp6 0 0 127.0.0.1:42381 :::* LISTEN 5765/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5765/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5765/java tcp6 0 0 10.30.171.103:2550 :::* LISTEN 5765/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5765/java tcp6 0 0 :::6653 :::* LISTEN 5765/java tcp6 0 0 :::1790 :::* LISTEN 5765/java tcp6 0 0 10.30.171.103:2550 10.30.171.62:50100 ESTABLISHED 5765/java tcp6 0 0 127.0.0.1:56950 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.103:52376 10.30.171.62:2550 ESTABLISHED 5765/java tcp6 0 0 10.30.171.103:51006 10.30.170.112:2550 ESTABLISHED 5765/java tcp6 0 0 127.0.0.1:49366 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.103:2550 10.30.170.112:50882 ESTABLISHED 5765/java tcp6 0 0 10.30.171.103:51020 10.30.170.112:2550 ESTABLISHED 5765/java tcp6 0 0 10.30.171.103:2550 10.30.170.112:50894 ESTABLISHED 5765/java tcp6 0 0 10.30.171.103:2550 10.30.171.62:50112 ESTABLISHED 5765/java tcp6 32 0 10.30.171.103:41680 199.204.45.87:443 CLOSE_WAIT 5765/java tcp6 0 0 10.30.171.103:52372 10.30.171.62:2550 ESTABLISHED 5765/java tcp6 0 0 127.0.0.1:56952 127.0.0.1:44444 TIME_WAIT - udp 0 0 10.30.171.103:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5765/java looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.62 'sudo ps aux' Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5741 + echo 'karaf main: org.apache.karaf.main.Main, pid:5741' karaf main: org.apache.karaf.main.Main, pid:5741 + ssh 10.30.171.62 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5741' Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.112 'sudo ps aux' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5742 + echo 'karaf main: org.apache.karaf.main.Main, pid:5742' karaf main: org.apache.karaf.main.Main, pid:5742 + ssh 10.30.170.112 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5742' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.103 'sudo ps aux' Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5765 + echo 'karaf main: org.apache.karaf.main.Main, pid:5765' karaf main: org.apache.karaf.main.Main, pid:5765 + ssh 10.30.171.103 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5765' Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.62' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.62 -v ODL_SYSTEM_2_IP:10.30.170.112' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.62 -v ODL_SYSTEM_2_IP:10.30.170.112 -v ODL_SYSTEM_3_IP:10.30.171.103' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell-argon.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell-argon.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-argon: /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/testplans/controller-clustering-tell.txt + cat testplan.txt # Place the suites in run order: # disabling all "prefix based" suites. This functionality was newly # introduced with these tests in 2017. The assumption is that # development stopped in that area, but may continue at a later # time. Still, the tests are failing and no resources to solve the # failures at this time. If/When this changes, we can uncomment # those suites. Note that every suite is commented out with it's # accompanying "restart_with_tell_based_true" setup suite. # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_argon -v BUNDLEFOLDER:karaf-0.18.4-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.18.4-SNAPSHOT/karaf-0.18.4-20240427.194437-206.zip -v CONTROLLER:10.30.171.62 -v CONTROLLER1:10.30.170.112 -v CONTROLLER2:10.30.171.103 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-argon -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:argon -v ODL_SYSTEM_IP:10.30.171.62 -v ODL_SYSTEM_1_IP:10.30.171.62 -v ODL_SYSTEM_2_IP:10.30.170.112 -v ODL_SYSTEM_3_IP:10.30.171.103 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-argon/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-tell.txt ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes... ============================================================================== Get_Shard_Role :: Get shard role. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.62:8181/restconf/operations/cluster-admin:get-shard-role ------------------------------------------------------------------------------ Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Make_Leader_Local :: Make the loeader local and verify. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Leader :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Follower :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_All_Nodes :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status" Resolving variable '${response.text}' failed: AttributeError: 'ReadTimeout' object has no attribute 'text' ------------------------------------------------------------------------------ controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL | 9 tests, 0 passed, 9 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi... ============================================================================== Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.62', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te... ============================================================================== Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.62', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart2 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.62', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L... ============================================================================== Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.62', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C... ============================================================================== Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) 2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 3) Resolving variable '${response.status_code}' failed: AttributeError: 'No... [ Message content over the limit has been removed. ] 65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 67) TypeError: Expected argument 1 to be a dictionary, got None instead. 68) TypeError: Expected argument 1 to be a dictionary, got None instead. 69) Unrecognized Raft state: None 70) No leader found. 71) Too many Leaders. 72) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.62', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.171.62', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.171.62', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.171.62', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart_2 :: Restart odl. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_restart_2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.62', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.103', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic... ============================================================================== Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Persistence Recovery :: This test restar... ============================================================================== Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover :: This test focuses on test... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe... ============================================================================== Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.171.62:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test... ============================================================================== Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.112:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-tell.txt | FAIL | 162 tests, 11 passed, 151 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-tell-all-argon/output.xml Log: /w/workspace/controller-csit-3node-clustering-tell-all-argon/log.html Report: /w/workspace/controller-csit-3node-clustering-tell-all-argon/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.171.62 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. total 90436 drwxrwxr-x. 2 jenkins jenkins 48 Apr 27 23:09 . -rw-rw-r--. 1 jenkins jenkins 1720 Apr 27 23:09 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Apr 28 04:46 .. -rw-rw-r--. 1 jenkins jenkins 64560068 Apr 28 05:01 karaf.log + ssh 10.30.171.62 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log 89M /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log + ssh 10.30.170.112 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. total 86020 drwxrwxr-x. 2 jenkins jenkins 48 Apr 27 23:09 . -rw-rw-r--. 1 jenkins jenkins 1720 Apr 27 23:09 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Apr 28 04:46 .. -rw-rw-r--. 1 jenkins jenkins 60574789 Apr 28 05:01 karaf.log + ssh 10.30.170.112 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log 84M /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log + ssh 10.30.171.103 'ls -altr /tmp/karaf-0.18.4-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. total 131192 drwxrwxr-x. 2 jenkins jenkins 48 Apr 27 23:09 . -rw-rw-r--. 1 jenkins jenkins 187625 Apr 28 00:01 karaf_console.log drwxrwxr-x. 4 jenkins jenkins 28 Apr 28 04:46 .. -rw-rw-r--. 1 jenkins jenkins 85452806 Apr 28 05:01 karaf.log + ssh 10.30.171.103 'du -hs /tmp/karaf-0.18.4-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. 184K /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log 128M /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.62 'sudo ps aux' Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=31037 + echo 'karaf main: org.apache.karaf.main.Main, pid:31037' karaf main: org.apache.karaf.main.Main, pid:31037 + ssh 10.30.171.62 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 31037' Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.62 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.112 'sudo ps aux' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' + pid=28984 + echo 'karaf main: org.apache.karaf.main.Main, pid:28984' karaf main: org.apache.karaf.main.Main, pid:28984 + ssh 10.30.170.112 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 28984' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.112 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.103 'sudo ps aux' Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-argon/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5765 + echo 'karaf main: org.apache.karaf.main.Main, pid:5765' karaf main: org.apache.karaf.main.Main, pid:5765 + ssh 10.30.171.103 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5765' Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.103 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.171.62 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.171.62:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. + ssh 10.30.171.62 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. + scp 10.30.171.62:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. + ssh 10.30.171.62 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.171.62:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.171.62' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.170.112 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.170.112:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + ssh 10.30.170.112 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + scp 10.30.170.112:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + ssh 10.30.170.112 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.170.112:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.170.112' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.171.103 gzip --best /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.171.103:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + ssh 10.30.171.103 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + scp 10.30.171.103:/tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + ssh 10.30.171.103 rm -f /tmp/karaf-0.18.4-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.171.103:/tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.171.103' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.18.4-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 72780 drwxrwxr-x. 2 jenkins jenkins 6 Apr 28 05:01 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 187625 Apr 28 05:01 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 1884340 Apr 28 05:01 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Apr 28 05:01 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 28 05:01 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 2048064 Apr 28 05:01 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Apr 28 05:01 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 28 05:01 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 2225023 Apr 28 05:01 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 168517 Apr 28 05:01 karaf_3_5765_threads_after.log -rw-rw-r--. 1 jenkins jenkins 15788 Apr 28 05:01 ps_after.log -rw-rw-r--. 1 jenkins jenkins 160704 Apr 28 05:01 karaf_2_28984_threads_after.log -rw-rw-r--. 1 jenkins jenkins 156841 Apr 28 05:01 karaf_1_31037_threads_after.log -rw-rw-r--. 1 jenkins jenkins 306076 Apr 28 05:01 report.html -rw-rw-r--. 1 jenkins jenkins 3499220 Apr 28 05:01 log.html -rw-rw-r--. 1 jenkins jenkins 63198252 Apr 28 05:00 output.xml -rw-rw-r--. 1 jenkins jenkins 5952 Apr 27 23:11 testplan.txt -rw-rw-r--. 1 jenkins jenkins 180962 Apr 27 23:11 karaf_3_5765_threads_before.log -rw-rw-r--. 1 jenkins jenkins 16619 Apr 27 23:11 ps_before.log -rw-rw-r--. 1 jenkins jenkins 180270 Apr 27 23:11 karaf_2_5742_threads_before.log -rw-rw-r--. 1 jenkins jenkins 183919 Apr 27 23:11 karaf_1_5741_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Apr 27 23:09 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Apr 27 23:09 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3454 Apr 27 23:09 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Apr 27 23:09 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 133 Apr 27 23:09 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 337 Apr 27 23:09 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2620 Apr 27 23:09 pom.xml -rw-rw-r--. 1 jenkins jenkins 86 Apr 27 23:09 set_variables.env -rw-rw-r--. 1 jenkins jenkins 312 Apr 27 23:09 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Apr 27 23:08 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Apr 27 23:08 env.properties -rw-rw-r--. 1 jenkins jenkins 335 Apr 27 23:06 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Apr 27 23:05 test drwxrwxr-x. 2 jenkins jenkins 6 Apr 27 23:05 test@tmp -rw-rw-r--. 1 jenkins jenkins 1410 Apr 27 19:44 maven-metadata.xml + true [controller-csit-3node-clustering-tell-all-argon] $ /bin/sh /tmp/jenkins8344322384010981642.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5281 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins16536612678408724764.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 3176k 0 3176k 0 0 4609k 0 --:--:-- --:--:-- --:--:-- 4602k 100 4976k 0 4976k 0 0 4822k 0 --:--:-- 0:00:01 --:--:-- 4822k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins1992834675117846729.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-argon-83 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins8528244921991645741.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-argon-83 DEBUG: Successfully retrieved stack cost: total: 1.98 INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-argon-83 Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-argon-83 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins6945492509523872300.sh ---> sysstat.sh [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins9997281267427771154.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-argon + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-argon ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-argon ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-argon/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-argon/archives/ [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins9212315824405846491.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins885035755772648343.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-argon #83 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-argon@tmp/config2654883546804786872tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins16440958599396640601.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins9557487071672122255.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins14779156485735988639.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash /tmp/jenkins12099225063999501339.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH DEBUG: total: 1.98 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-tell-all-argon] $ /bin/bash -l /tmp/jenkins18421216400228943374.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-argon/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-RKtB from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-RKtB/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-argon/83/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-16223.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 9.6G 31G 24% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 667 4575 19 2454 6733 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:de:6a:63 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.171.67/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 64886sec preferred_lft 64886sec inet6 fe80::f816:3eff:fede:6a63/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-16223.novalocal) 04/28/2024 _x86_64_ (2 CPU) 12:00:02 AM tps rtps wtps bread/s bwrtn/s 12:01:01 AM 1.14 0.02 1.12 0.14 214.81 12:02:01 AM 0.45 0.07 0.38 1.73 22.09 12:03:01 AM 0.22 0.00 0.22 0.00 5.88 12:04:01 AM 0.10 0.00 0.10 0.00 1.03 12:05:01 AM 0.17 0.00 0.17 0.00 4.08 12:06:01 AM 0.25 0.00 0.25 0.00 4.62 12:07:01 AM 0.25 0.00 0.25 0.00 6.11 12:08:01 AM 0.43 0.07 0.37 7.60 9.47 12:09:01 AM 0.35 0.00 0.35 0.00 8.41 12:10:01 AM 0.17 0.00 0.17 0.00 4.62 12:11:01 AM 0.38 0.00 0.38 0.00 8.18 12:12:01 AM 0.68 0.30 0.38 6.40 5.20 12:13:01 AM 0.72 0.00 0.72 0.00 18.46 12:14:01 AM 0.17 0.00 0.17 0.00 1.87 12:15:01 AM 0.15 0.00 0.15 0.00 3.02 12:16:01 AM 0.25 0.00 0.25 0.00 12.60 12:17:01 AM 0.28 0.00 0.28 0.00 16.95 12:18:01 AM 0.18 0.00 0.18 0.00 14.81 12:19:01 AM 0.28 0.00 0.28 0.00 17.01 12:20:01 AM 0.35 0.00 0.35 0.00 17.83 12:21:01 AM 0.15 0.00 0.15 0.00 7.78 12:22:01 AM 0.27 0.00 0.27 0.00 12.95 12:23:01 AM 0.17 0.00 0.17 0.00 3.45 12:24:01 AM 0.22 0.00 0.22 0.00 2.93 12:25:01 AM 0.38 0.00 0.38 0.00 13.07 12:26:01 AM 0.17 0.00 0.17 0.00 8.43 12:27:01 AM 0.13 0.00 0.13 0.00 14.73 12:28:01 AM 0.20 0.00 0.20 0.00 10.43 12:29:01 AM 0.18 0.00 0.18 0.00 16.16 12:30:01 AM 0.20 0.00 0.20 0.00 16.48 12:31:01 AM 0.43 0.00 0.43 0.00 19.86 12:32:01 AM 0.28 0.00 0.28 0.00 23.43 12:33:01 AM 0.32 0.00 0.32 0.00 8.56 12:34:01 AM 0.22 0.00 0.22 0.00 2.70 12:35:01 AM 0.23 0.00 0.23 0.00 6.56 12:36:01 AM 0.22 0.00 0.22 0.00 3.77 12:37:01 AM 0.15 0.00 0.15 0.00 1.07 12:38:01 AM 0.12 0.00 0.12 0.00 3.48 12:39:01 AM 0.28 0.00 0.28 0.00 3.78 12:40:01 AM 0.30 0.00 0.30 0.00 10.30 12:41:01 AM 0.25 0.00 0.25 0.00 6.08 12:42:01 AM 0.20 0.00 0.20 0.00 3.05 12:43:01 AM 0.13 0.00 0.13 0.00 3.05 12:44:01 AM 0.15 0.00 0.15 0.00 9.91 12:45:01 AM 0.25 0.00 0.25 0.00 15.58 12:46:01 AM 0.33 0.00 0.33 0.00 19.49 12:47:01 AM 0.17 0.00 0.17 0.00 9.22 12:48:01 AM 0.18 0.00 0.18 0.00 12.40 12:49:01 AM 0.15 0.00 0.15 0.00 15.10 12:50:01 AM 0.20 0.00 0.20 0.00 11.28 12:51:01 AM 0.52 0.00 0.52 0.00 10.86 12:52:01 AM 0.53 0.00 0.53 0.00 18.91 12:53:01 AM 0.63 0.00 0.63 0.00 16.76 12:54:01 AM 0.15 0.00 0.15 0.00 13.88 12:55:01 AM 0.22 0.00 0.22 0.00 16.35 12:56:01 AM 0.20 0.00 0.20 0.00 10.21 12:57:01 AM 0.23 0.00 0.23 0.00 15.50 12:58:01 AM 0.13 0.00 0.13 0.00 13.73 12:59:01 AM 0.90 0.00 0.90 0.00 15.36 01:00:01 AM 0.35 0.03 0.32 0.27 20.10 01:01:01 AM 0.28 0.00 0.28 0.00 19.41 01:02:01 AM 0.28 0.00 0.28 0.00 10.79 01:03:01 AM 0.23 0.00 0.23 0.00 17.99 01:04:02 AM 0.15 0.00 0.15 0.00 8.83 01:05:01 AM 0.20 0.00 0.20 0.00 15.39 01:06:01 AM 0.23 0.00 0.23 0.00 23.64 01:07:01 AM 0.18 0.00 0.18 0.00 2.80 01:08:01 AM 0.10 0.00 0.10 0.00 1.20 01:09:01 AM 0.28 0.00 0.28 0.00 6.13 01:10:01 AM 0.18 0.00 0.18 0.00 2.62 01:11:01 AM 0.27 0.00 0.27 0.00 6.33 01:12:01 AM 0.20 0.00 0.20 0.00 2.68 01:13:01 AM 0.12 0.00 0.12 0.00 6.42 01:14:01 AM 0.15 0.00 0.15 0.00 3.22 01:15:01 AM 0.15 0.00 0.15 0.00 3.92 01:16:01 AM 0.33 0.00 0.33 0.00 4.93 01:17:01 AM 0.18 0.00 0.18 0.00 3.88 01:18:01 AM 0.13 0.00 0.13 0.00 16.68 01:19:01 AM 0.18 0.00 0.18 0.00 14.45 01:20:01 AM 0.37 0.00 0.37 0.00 17.18 01:21:01 AM 0.30 0.00 0.30 0.00 15.49 01:22:01 AM 0.33 0.00 0.33 0.00 13.48 01:23:01 AM 0.23 0.00 0.23 0.00 16.51 01:24:01 AM 0.17 0.00 0.17 0.00 4.42 01:25:01 AM 0.40 0.00 0.40 0.00 14.33 01:26:01 AM 0.25 0.00 0.25 0.00 17.50 01:27:01 AM 0.15 0.00 0.15 0.00 9.60 01:28:01 AM 0.15 0.00 0.15 0.00 14.16 01:29:01 AM 0.13 0.00 0.13 0.00 8.13 01:30:01 AM 0.22 0.00 0.22 0.00 18.46 01:31:01 AM 0.37 0.00 0.37 0.00 17.66 01:32:01 AM 0.27 0.00 0.27 0.00 22.71 01:33:01 AM 0.15 0.00 0.15 0.00 1.98 01:34:01 AM 0.12 0.00 0.12 0.00 0.78 01:35:01 AM 0.30 0.00 0.30 0.00 7.95 01:36:01 AM 0.15 0.00 0.15 0.00 2.02 01:37:01 AM 0.13 0.00 0.13 0.00 3.60 01:38:01 AM 0.12 0.00 0.12 0.00 1.17 01:39:01 AM 0.12 0.00 0.12 0.00 6.40 01:40:01 AM 0.32 0.00 0.32 0.00 6.65 01:41:01 AM 0.33 0.00 0.33 0.00 7.95 01:42:01 AM 0.22 0.00 0.22 0.00 3.57 01:43:01 AM 0.13 0.00 0.13 0.00 4.10 01:44:01 AM 0.12 0.00 0.12 0.00 1.18 01:45:01 AM 0.25 0.00 0.25 0.00 6.46 01:46:01 AM 0.28 0.00 0.28 0.00 4.97 01:47:01 AM 0.28 0.00 0.28 0.00 6.51 01:48:01 AM 0.22 0.00 0.22 0.00 2.75 01:49:01 AM 0.15 0.00 0.15 0.00 4.00 01:50:01 AM 0.35 0.00 0.35 0.00 3.83 01:51:01 AM 0.42 0.00 0.42 0.00 8.56 01:52:01 AM 0.35 0.00 0.35 0.00 4.25 01:53:01 AM 0.27 0.00 0.27 0.00 5.63 01:54:01 AM 0.28 0.00 0.28 0.00 3.33 01:55:01 AM 0.23 0.00 0.23 0.00 2.88 01:56:01 AM 0.23 0.00 0.23 0.00 14.85 01:57:01 AM 0.22 0.00 0.22 0.00 12.01 01:58:01 AM 0.13 0.00 0.13 0.00 13.60 01:59:01 AM 0.13 0.00 0.13 0.00 14.40 02:00:01 AM 0.17 0.00 0.17 0.00 8.90 02:01:01 AM 0.37 0.00 0.37 0.00 18.23 02:02:01 AM 0.28 0.00 0.28 0.00 15.09 02:03:01 AM 0.13 0.00 0.13 0.00 5.60 02:04:01 AM 0.10 0.00 0.10 0.00 1.22 02:05:01 AM 0.22 0.00 0.22 0.00 2.47 02:06:01 AM 0.32 0.00 0.32 0.00 7.72 02:07:01 AM 0.15 0.00 0.15 0.00 1.22 02:08:01 AM 0.27 0.00 0.27 0.00 6.26 02:09:01 AM 0.15 0.00 0.15 0.00 1.45 02:10:01 AM 0.17 0.00 0.17 0.00 4.88 02:11:02 AM 0.30 0.00 0.30 0.00 4.48 02:12:01 AM 0.17 0.00 0.17 0.00 5.73 02:13:01 AM 0.20 0.00 0.20 0.00 1.87 02:14:01 AM 0.13 0.00 0.13 0.00 4.00 02:15:01 AM 0.25 0.00 0.25 0.00 3.25 02:16:01 AM 0.25 0.00 0.25 0.00 7.92 02:17:01 AM 0.18 0.00 0.18 0.00 19.21 02:18:01 AM 0.15 0.00 0.15 0.00 8.16 02:19:01 AM 0.18 0.00 0.18 0.00 14.95 02:20:01 AM 0.32 0.00 0.32 0.00 15.31 02:21:01 AM 0.32 0.00 0.32 0.00 15.09 02:22:01 AM 0.25 0.00 0.25 0.00 18.38 02:23:01 AM 0.17 0.00 0.17 0.00 5.22 02:24:01 AM 0.12 0.00 0.12 0.00 1.30 02:25:01 AM 0.15 0.00 0.15 0.00 4.58 02:26:01 AM 0.22 0.00 0.22 0.00 3.62 02:27:01 AM 0.12 0.00 0.12 0.00 0.92 02:28:01 AM 0.13 0.00 0.13 0.00 4.38 02:29:01 AM 0.10 0.00 0.10 0.00 1.05 02:30:01 AM 0.32 0.00 0.32 0.00 7.40 02:31:01 AM 0.38 0.00 0.38 0.00 6.27 02:32:01 AM 0.23 0.00 0.23 0.00 6.80 02:33:01 AM 0.12 0.00 0.12 0.00 1.20 02:34:01 AM 0.22 0.00 0.22 0.00 5.25 02:35:01 AM 0.18 0.00 0.18 0.00 1.42 02:36:01 AM 0.25 0.00 0.25 0.00 7.25 02:37:01 AM 0.17 0.00 0.17 0.00 16.96 02:38:01 AM 0.15 0.00 0.15 0.00 13.90 02:39:01 AM 0.28 0.00 0.28 0.00 11.83 02:40:01 AM 0.17 0.00 0.17 0.00 15.28 02:41:01 AM 0.47 0.00 0.47 0.00 19.53 02:42:01 AM 0.48 0.00 0.48 0.00 16.11 02:43:01 AM 0.25 0.00 0.25 0.00 6.76 02:44:01 AM 0.15 0.00 0.15 0.00 2.02 02:45:01 AM 0.32 0.00 0.32 0.00 8.50 02:46:01 AM 0.30 0.00 0.30 0.00 3.92 02:47:01 AM 0.15 0.00 0.15 0.00 1.62 02:48:01 AM 0.18 0.00 0.18 0.00 5.20 02:49:01 AM 0.13 0.00 0.13 0.00 0.92 02:50:01 AM 0.30 0.00 0.30 0.00 8.66 02:51:01 AM 0.18 0.00 0.18 0.00 2.17 02:52:01 AM 0.20 0.00 0.20 0.00 6.02 02:53:01 AM 0.12 0.00 0.12 0.00 0.80 02:54:01 AM 0.28 0.00 0.28 0.00 7.11 02:55:01 AM 2.25 0.03 2.22 1.07 43.83 02:56:01 AM 0.38 0.00 0.38 0.00 16.25 02:57:01 AM 0.22 0.00 0.22 0.00 16.38 02:58:01 AM 0.13 0.00 0.13 0.00 13.90 02:59:01 AM 0.23 0.00 0.23 0.00 13.08 03:00:01 AM 0.30 0.00 0.30 0.00 14.99 03:01:01 AM 0.45 0.00 0.45 0.00 16.79 03:02:01 AM 0.35 0.00 0.35 0.00 19.25 03:03:01 AM 0.13 0.00 0.13 0.00 15.90 03:04:01 AM 0.28 0.00 0.28 0.00 6.51 03:05:01 AM 0.35 0.00 0.35 0.00 3.55 03:06:01 AM 0.53 0.00 0.53 0.00 9.85 03:07:01 AM 0.33 0.00 0.33 0.00 3.82 03:08:01 AM 0.30 0.00 0.30 0.00 5.75 03:09:01 AM 0.38 0.00 0.38 0.00 4.13 03:10:01 AM 0.35 0.00 0.35 0.00 9.16 03:11:02 AM 0.23 0.00 0.23 0.00 5.58 03:12:01 AM 0.24 0.00 0.24 0.00 5.05 03:13:01 AM 0.22 0.00 0.22 0.00 2.80 03:14:01 AM 0.22 0.00 0.22 0.00 4.55 03:15:01 AM 0.22 0.00 0.22 0.00 16.76 03:16:01 AM 0.27 0.00 0.27 0.00 10.51 03:17:01 AM 0.20 0.00 0.20 0.00 14.81 03:18:01 AM 0.15 0.00 0.15 0.00 16.80 03:19:01 AM 0.12 0.00 0.12 0.00 7.47 03:20:01 AM 0.23 0.00 0.23 0.00 17.52 03:21:01 AM 0.35 0.00 0.35 0.00 10.63 03:22:01 AM 0.25 0.00 0.25 0.00 6.70 03:23:01 AM 0.13 0.00 0.13 0.00 16.53 03:24:01 AM 0.27 0.00 0.27 0.00 13.58 03:25:01 AM 0.20 0.00 0.20 0.00 11.91 03:26:01 AM 0.23 0.00 0.23 0.00 15.50 03:27:01 AM 0.15 0.00 0.15 0.00 14.79 03:28:01 AM 0.13 0.00 0.13 0.00 9.73 03:29:01 AM 0.12 0.00 0.12 0.00 5.20 03:30:01 AM 0.30 0.00 0.30 0.00 15.83 03:31:01 AM 0.37 0.00 0.37 0.00 18.78 03:32:01 AM 0.20 0.00 0.20 0.00 15.23 03:33:01 AM 0.23 0.00 0.23 0.00 12.93 03:34:01 AM 0.55 0.00 0.55 0.00 16.94 03:35:01 AM 0.42 0.00 0.42 0.00 15.99 03:36:01 AM 0.23 0.00 0.23 0.00 9.93 03:37:01 AM 0.23 0.00 0.23 0.00 22.38 03:38:01 AM 0.17 0.00 0.17 0.00 2.12 03:39:01 AM 0.10 0.00 0.10 0.00 0.65 03:40:01 AM 0.17 0.00 0.17 0.00 4.31 03:41:01 AM 0.27 0.00 0.27 0.00 4.48 03:42:01 AM 0.17 0.00 0.17 0.00 4.55 03:43:01 AM 0.15 0.00 0.15 0.00 1.58 03:44:01 AM 0.23 0.00 0.23 0.00 8.53 03:45:01 AM 0.25 0.00 0.25 0.00 8.93 03:46:01 AM 0.45 0.00 0.45 0.00 6.83 03:47:01 AM 0.35 0.00 0.35 0.00 5.22 03:48:01 AM 0.17 0.00 0.17 0.00 3.10 03:49:01 AM 0.12 0.00 0.12 0.00 2.80 03:50:01 AM 0.17 0.00 0.17 0.00 4.73 03:51:01 AM 0.43 0.00 0.43 0.00 11.16 03:52:01 AM 0.47 0.00 0.47 0.00 5.98 03:53:01 AM 0.38 0.00 0.38 0.00 8.41 03:54:01 AM 0.30 0.00 0.30 0.00 10.67 03:55:01 AM 0.18 0.00 0.18 0.00 13.91 03:56:01 AM 0.23 0.00 0.23 0.00 16.29 03:57:01 AM 0.12 0.00 0.12 0.00 7.99 03:58:01 AM 0.15 0.00 0.15 0.00 14.66 03:59:01 AM 0.13 0.00 0.13 0.00 14.26 04:00:01 AM 0.33 0.00 0.33 0.00 28.11 04:01:01 AM 0.28 0.00 0.28 0.00 7.10 04:02:01 AM 0.22 0.00 0.22 0.00 3.37 04:03:01 AM 0.12 0.00 0.12 0.00 3.46 04:04:01 AM 0.08 0.00 0.08 0.00 0.62 04:05:01 AM 0.33 0.00 0.33 0.00 4.67 04:06:01 AM 0.33 0.00 0.33 0.00 7.93 04:07:01 AM 0.20 0.00 0.20 0.00 2.63 04:08:01 AM 0.25 0.00 0.25 0.00 9.98 04:09:01 AM 0.27 0.00 0.27 0.00 7.45 04:10:01 AM 0.22 0.00 0.22 0.00 3.15 04:11:01 AM 0.28 0.00 0.28 0.00 5.76 04:12:01 AM 0.35 0.00 0.35 0.00 9.08 04:13:01 AM 0.20 0.00 0.20 0.00 3.40 04:14:01 AM 0.23 0.00 0.23 0.00 7.11 04:15:01 AM 0.32 0.00 0.32 0.00 8.88 04:16:01 AM 0.42 0.00 0.42 0.00 5.10 04:17:01 AM 0.22 0.00 0.22 0.00 7.16 04:18:01 AM 0.12 0.00 0.12 0.00 9.33 04:19:01 AM 0.13 0.00 0.13 0.00 14.26 04:20:01 AM 0.23 0.00 0.23 0.00 11.00 04:21:01 AM 0.92 0.00 0.92 0.00 26.57 04:22:01 AM 0.42 0.00 0.42 0.00 22.06 04:23:01 AM 0.13 0.00 0.13 0.00 7.46 04:24:01 AM 0.15 0.00 0.15 0.00 25.86 04:25:01 AM 0.52 0.00 0.52 0.00 8.86 04:26:01 AM 0.37 0.00 0.37 0.00 4.98 04:27:01 AM 0.45 0.00 0.45 0.00 7.33 04:28:01 AM 0.35 0.00 0.35 0.00 3.87 04:29:01 AM 0.37 0.00 0.37 0.00 6.28 04:30:01 AM 0.38 0.00 0.38 0.00 4.10 04:31:01 AM 0.48 0.00 0.48 0.00 11.86 04:32:01 AM 0.52 0.00 0.52 0.00 8.48 04:33:01 AM 0.33 0.00 0.33 0.00 8.40 04:34:01 AM 0.37 0.00 0.37 0.00 4.55 04:35:01 AM 0.43 0.00 0.43 0.00 6.10 04:36:01 AM 0.47 0.00 0.47 0.00 6.68 04:37:01 AM 0.42 0.00 0.42 0.00 10.28 04:38:01 AM 0.13 0.00 0.13 0.00 1.73 04:39:01 AM 0.10 0.00 0.10 0.00 0.63 04:40:01 AM 0.15 0.00 0.15 0.00 6.08 04:41:01 AM 0.53 0.00 0.53 0.00 21.96 04:42:01 AM 0.62 0.00 0.62 0.00 18.31 04:43:01 AM 0.53 0.00 0.53 0.00 16.93 04:44:01 AM 0.47 0.00 0.47 0.00 15.45 04:45:01 AM 0.58 0.00 0.58 0.00 17.46 04:46:01 AM 0.65 0.00 0.65 0.00 19.38 04:47:01 AM 0.20 0.00 0.20 0.00 21.58 04:48:02 AM 0.22 0.00 0.22 0.00 5.30 04:49:01 AM 0.20 0.00 0.20 0.00 2.27 04:50:01 AM 0.20 0.00 0.20 0.00 4.63 04:51:01 AM 0.25 0.00 0.25 0.00 4.07 04:52:01 AM 0.20 0.00 0.20 0.00 5.60 04:53:01 AM 0.15 0.00 0.15 0.00 1.48 04:54:01 AM 0.10 0.00 0.10 0.00 1.18 04:55:01 AM 0.23 0.00 0.23 0.00 14.48 04:56:01 AM 0.52 0.00 0.52 0.00 11.63 04:57:01 AM 0.15 0.00 0.15 0.00 8.42 04:58:01 AM 0.18 0.00 0.18 0.00 13.91 04:59:01 AM 0.18 0.00 0.18 0.00 8.57 05:00:01 AM 0.15 0.00 0.15 0.00 12.33 05:01:01 AM 0.27 0.00 0.27 0.00 15.41 05:02:01 AM 16.64 0.22 16.42 31.97 3310.36 05:03:01 AM 26.36 0.42 25.94 48.25 990.44 Average: 0.41 0.00 0.40 0.32 24.25 12:00:02 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:01:01 AM 4754704 6993776 3127724 39.68 2688 2408516 781344 8.75 383012 2368960 32 12:02:01 AM 4754588 6994304 3127840 39.68 2688 2409152 781344 8.75 383080 2369404 112 12:03:01 AM 4754132 6993848 3128296 39.69 2688 2409152 781344 8.75 383080 2369824 16 12:04:01 AM 4754528 6994244 3127900 39.68 2688 2409152 781344 8.75 383080 2369420 12 12:05:01 AM 4754476 6994272 3127952 39.68 2688 2409232 781344 8.75 383080 2369500 4 12:06:01 AM 4754212 6994008 3128216 39.69 2688 2409232 781344 8.75 383080 2369568 4 12:07:01 AM 4753648 6993524 3128780 39.69 2688 2409312 773904 8.67 383080 2370132 4 12:08:01 AM 4753968 6994184 3128460 39.69 2688 2409660 779400 8.73 383188 2369824 4 12:09:01 AM 4753864 6994244 3128564 39.69 2688 2409824 779400 8.73 383188 2370008 56 12:10:01 AM 4753456 6993892 3128972 39.70 2688 2409880 781936 8.76 383188 2370188 16 12:11:01 AM 4753360 6993884 3129068 39.70 2688 2409948 781936 8.76 383188 2370224 4 12:12:01 AM 4752216 6992856 3130212 39.71 2688 2410064 781936 8.76 383188 2371300 4 12:13:01 AM 4752128 6992868 3130300 39.71 2688 2410164 781936 8.76 383304 2371300 4 12:14:01 AM 4752164 6992912 3130264 39.71 2688 2410172 781936 8.76 383304 2371308 4 12:15:01 AM 4752140 6993004 3130288 39.71 2688 2410296 781936 8.76 383304 2371436 80 12:16:01 AM 4751480 6992724 3130948 39.72 2688 2410668 781936 8.76 383304 2372024 192 12:17:01 AM 4751352 6992944 3131076 39.72 2688 2411024 781936 8.76 383304 2372168 128 12:18:01 AM 4750904 6992856 3131524 39.73 2688 2411376 781936 8.76 383304 2372644 88 12:19:01 AM 4750784 6993088 3131644 39.73 2688 2411736 781936 8.76 383304 2372924 24 12:20:01 AM 4749924 6992588 3132504 39.74 2688 2412096 787332 8.82 383304 2373572 24 12:21:01 AM 4749744 6992772 3132684 39.74 2688 2412452 787332 8.82 383304 2373912 192 12:22:01 AM 4749952 6993108 3132476 39.74 2688 2412580 787332 8.82 383416 2373744 16 12:23:01 AM 4749760 6992952 3132668 39.74 2688 2412616 787332 8.82 383416 2373876 4 12:24:01 AM 4749428 6992632 3133000 39.75 2688 2412628 787332 8.82 383416 2374032 16 12:25:01 AM 4748876 6992288 3133552 39.75 2688 2412836 787332 8.82 383416 2374736 16 12:26:01 AM 4747028 6990816 3135400 39.78 2688 2413212 787332 8.82 383416 2376568 184 12:27:01 AM 4746020 6990152 3136408 39.79 2688 2413564 787332 8.82 383416 2377476 132 12:28:01 AM 4745876 6990368 3136552 39.79 2688 2413916 787332 8.82 383416 2377564 216 12:29:01 AM 4745460 6990304 3136968 39.80 2688 2414276 787332 8.82 383416 2378076 152 12:30:01 AM 4744932 6990124 3137496 39.80 2688 2414616 770372 8.63 383416 2378472 72 12:31:01 AM 4744520 6990068 3137908 39.81 2688 2414980 770372 8.63 383416 2378780 72 12:32:01 AM 4744192 6990308 3138236 39.81 2688 2415540 770372 8.63 383440 2379260 64 12:33:01 AM 4743960 6990148 3138468 39.82 2688 2415612 770372 8.63 383448 2379620 4 12:34:01 AM 4743824 6990012 3138604 39.82 2688 2415612 770372 8.63 383440 2379472 16 12:35:01 AM 4743804 6990072 3138624 39.82 2688 2415692 770372 8.63 383440 2379788 4 12:36:01 AM 4744024 6990296 3138404 39.82 2688 2415696 770372 8.63 383440 2379548 4 12:37:01 AM 4744064 6990416 3138364 39.81 2688 2415776 770372 8.63 383440 2379560 88 12:38:01 AM 4743824 6990176 3138604 39.82 2688 2415776 770372 8.63 383440 2379560 4 12:39:01 AM 4743748 6990268 3138680 39.82 2688 2415944 770372 8.63 383440 2379732 172 12:40:01 AM 4743328 6989904 3139100 39.82 2688 2416000 785868 8.80 383440 2379912 16 12:41:01 AM 4743528 6990172 3138900 39.82 2688 2416068 785868 8.80 383440 2380016 4 12:42:01 AM 4742956 6989600 3139472 39.83 2688 2416068 785868 8.80 383440 2380392 8 12:43:01 AM 4743284 6989984 3139144 39.82 2688 2416124 785868 8.80 383440 2380196 8 12:44:01 AM 4742980 6990076 3139448 39.83 2688 2416528 785868 8.80 383440 2380528 152 12:45:01 AM 4742776 6990228 3139652 39.83 2688 2416876 785868 8.80 383440 2380684 104 12:46:01 AM 4742048 6989852 3140380 39.84 2688 2417236 785868 8.80 383440 2381248 40 12:47:01 AM 4741548 6989708 3140880 39.85 2688 2417584 785868 8.80 383440 2381704 176 12:48:01 AM 4741604 6990112 3140824 39.85 2688 2417932 785868 8.80 383440 2381768 192 12:49:01 AM 4741444 6990312 3140984 39.85 2688 2418292 785868 8.80 383440 2382128 128 12:50:01 AM 4741000 6990036 3141428 39.85 2688 2418464 785340 8.79 383440 2382440 4 12:51:01 AM 4740804 6990028 3141624 39.86 2688 2418652 785340 8.79 383440 2382684 80 12:52:01 AM 4741064 6990636 3141364 39.85 2688 2419000 785340 8.79 383444 2382556 16 12:53:01 AM 4740408 6990340 3142020 39.86 2688 2419360 785340 8.79 383444 2383204 120 12:54:01 AM 4739232 6989524 3143196 39.88 2688 2419720 785340 8.79 383444 2384244 96 12:55:01 AM 4738928 6989568 3143500 39.88 2688 2420076 785340 8.79 383444 2384592 24 12:56:01 AM 4738448 6989436 3143980 39.89 2688 2420424 785340 8.79 383444 2385124 168 12:57:01 AM 4738148 6989492 3144280 39.89 2688 2420772 785340 8.79 383444 2385552 128 12:58:01 AM 4735880 6987536 3146548 39.92 2688 2421084 779188 8.72 383444 2387468 60 12:59:01 AM 4737692 6989564 3144736 39.90 2688 2421296 777652 8.71 392872 2376408 200 01:00:01 AM 4735760 6987972 3146668 39.92 2688 2421636 779212 8.72 392872 2377556 96 01:01:01 AM 4735852 6988448 3146576 39.92 2688 2422008 779212 8.72 392876 2377992 24 01:02:01 AM 4736644 6989592 3145784 39.91 2688 2422360 779212 8.72 392884 2377572 176 01:03:01 AM 4735620 6988916 3146808 39.92 2688 2422708 779212 8.72 392884 2378232 84 01:04:02 AM 4735552 6989196 3146876 39.92 2688 2423064 779212 8.72 392884 2378436 212 01:05:01 AM 4734964 6989316 3147464 39.93 2688 2423764 779212 8.72 392884 2379192 524 01:06:01 AM 4734732 6989200 3147696 39.93 2688 2423880 779212 8.72 392884 2379312 40 01:07:01 AM 4735004 6989472 3147424 39.93 2688 2423880 779212 8.72 392884 2378992 4 01:08:01 AM 4734824 6989376 3147604 39.93 2688 2423964 779212 8.72 392884 2379280 88 01:09:01 AM 4734932 6989484 3147496 39.93 2688 2423964 779212 8.72 392884 2379220 4 01:10:01 AM 4734444 6988996 3147984 39.94 2688 2423964 779248 8.73 392884 2379488 4 01:11:01 AM 4734788 6989420 3147640 39.93 2688 2424044 779248 8.73 392884 2379320 4 01:12:01 AM 4734760 6989392 3147668 39.93 2688 2424044 779248 8.73 392884 2379300 4 01:13:01 AM 4734608 6989416 3147820 39.93 2688 2424220 779248 8.73 392884 2379380 16 01:14:01 AM 4734408 6989332 3148020 39.94 2688 2424336 779248 8.73 392884 2379704 92 01:15:01 AM 4734600 6989524 3147828 39.93 2688 2424336 779248 8.73 392884 2379492 8 01:16:01 AM 4734380 6989356 3148048 39.94 2688 2424388 779248 8.73 392884 2379616 60 01:17:01 AM 4734284 6989472 3148144 39.94 2688 2424600 797160 8.93 392884 2379864 208 01:18:01 AM 4733860 6989400 3148568 39.94 2688 2424952 797160 8.93 392884 2380224 88 01:19:01 AM 4733500 6989388 3148928 39.95 2688 2425308 797160 8.93 392884 2380576 52 01:20:01 AM 4733000 6989256 3149428 39.96 2688 2425664 785908 8.80 392884 2380952 4 01:21:01 AM 4732768 6989384 3149660 39.96 2688 2426024 785908 8.80 392884 2381332 32 01:22:01 AM 4732228 6989196 3150200 39.96 2688 2426384 785908 8.80 392884 2381732 148 01:23:01 AM 4731892 6989184 3150536 39.97 2688 2426696 785908 8.80 392884 2382180 48 01:24:01 AM 4731656 6989188 3150772 39.97 2688 2426936 785908 8.80 392884 2382388 208 01:25:01 AM 4731376 6989100 3151052 39.98 2688 2427136 785908 8.80 392884 2382576 104 01:26:01 AM 4731132 6989200 3151296 39.98 2688 2427480 785908 8.80 392884 2382852 24 01:27:01 AM 4730812 6989224 3151616 39.98 2688 2427824 785908 8.80 392884 2383268 124 01:28:01 AM 4730332 6989096 3152096 39.99 2688 2428168 785908 8.80 392884 2383740 72 01:29:01 AM 4730176 6989292 3152252 39.99 2688 2428520 785908 8.80 392884 2383840 208 01:30:01 AM 4729376 6988844 3153052 40.00 2688 2428880 766084 8.58 392884 2384428 88 01:31:01 AM 4728960 6989040 3153468 40.01 2688 2429484 766084 8.58 392884 2384880 320 01:32:01 AM 4728844 6989192 3153584 40.01 2688 2429752 766084 8.58 392884 2385236 16 01:33:01 AM 4728668 6989020 3153760 40.01 2688 2429756 781692 8.75 392884 2385308 4 01:34:01 AM 4728832 6989192 3153596 40.01 2688 2429764 781692 8.75 392884 2385108 16 01:35:01 AM 4729024 6989452 3153404 40.01 2688 2429832 781692 8.75 392884 2385184 4 01:36:01 AM 4728760 6989192 3153668 40.01 2688 2429836 781692 8.75 392884 2385336 4 01:37:01 AM 4728764 6989276 3153664 40.01 2688 2429916 781692 8.75 392884 2385384 4 01:38:01 AM 4728876 6989388 3153552 40.01 2688 2429916 781692 8.75 392884 2385248 4 01:39:01 AM 4728580 6989268 3153848 40.01 2688 2430092 781692 8.75 392884 2385448 16 01:40:01 AM 4728012 6988812 3154416 40.02 2688 2430204 786072 8.80 392884 2385648 80 01:41:01 AM 4728240 6989044 3154188 40.02 2688 2430208 786072 8.80 392884 2385636 4 01:42:01 AM 4728356 6989160 3154072 40.01 2688 2430208 786072 8.80 392884 2385568 4 01:43:01 AM 4728444 6989320 3153984 40.01 2688 2430280 786072 8.80 392884 2385648 4 01:44:01 AM 4728424 6989300 3154004 40.01 2688 2430280 786072 8.80 392884 2385648 4 01:45:01 AM 4728072 6989028 3154356 40.02 2688 2430360 786072 8.80 392884 2385812 4 01:46:01 AM 4728248 6989204 3154180 40.02 2688 2430360 786072 8.80 392884 2385800 4 01:47:01 AM 4727772 6988808 3154656 40.02 2688 2430440 786072 8.80 392884 2386232 4 01:48:01 AM 4728232 6989272 3154196 40.02 2688 2430444 786072 8.80 392884 2385828 4 01:49:01 AM 4728128 6989256 3154300 40.02 2688 2430532 786072 8.80 392884 2386032 4 01:50:01 AM 4727760 6988888 3154668 40.02 2688 2430532 777896 8.71 392884 2386148 4 01:51:01 AM 4727836 6989044 3154592 40.02 2688 2430612 777896 8.71 392884 2386068 4 01:52:01 AM 4727868 6989076 3154560 40.02 2688 2430612 777896 8.71 392884 2386000 4 01:53:01 AM 4727856 6989148 3154572 40.02 2688 2430696 777896 8.71 392884 2386084 4 01:54:01 AM 4727784 6989076 3154644 40.02 2688 2430696 793272 8.88 392884 2386084 4 01:55:01 AM 4727732 6989108 3154696 40.02 2688 2430780 793272 8.88 392892 2386152 92 01:56:01 AM 4727712 6989420 3154716 40.02 2688 2431112 793272 8.88 392892 2386568 80 01:57:01 AM 4727356 6989416 3155072 40.03 2688 2431460 793272 8.88 392892 2386848 116 01:58:01 AM 4726800 6989212 3155628 40.03 2688 2431820 793272 8.88 392892 2387200 96 01:59:01 AM 4726484 6989260 3155944 40.04 2688 2432176 793272 8.88 392892 2387564 48 02:00:01 AM 4726020 6989152 3156408 40.04 2688 2432532 775924 8.69 392892 2387920 188 02:01:01 AM 4724848 6988344 3157580 40.06 2688 2432900 775924 8.69 392892 2388932 168 02:02:01 AM 4725692 6989404 3156736 40.05 2688 2433108 775924 8.69 392892 2388500 24 02:03:01 AM 4725040 6988864 3157388 40.06 2688 2433220 775924 8.69 392892 2389036 4 02:04:01 AM 4724988 6988816 3157440 40.06 2688 2433224 775924 8.69 392892 2389160 4 02:05:01 AM 4725416 6989336 3157012 40.05 2688 2433316 775924 8.69 392892 2388728 100 02:06:01 AM 4725512 6989428 3156916 40.05 2688 2433316 775924 8.69 392892 2388796 4 02:07:01 AM 4725260 6989272 3157168 40.05 2688 2433412 775924 8.69 392892 2388824 100 02:08:01 AM 4725412 6989424 3157016 40.05 2688 2433412 775924 8.69 392892 2388824 4 02:09:01 AM 4725276 6989380 3157152 40.05 2688 2433504 775924 8.69 392892 2388916 100 02:10:01 AM 4725072 6989180 3157356 40.06 2688 2433508 777996 8.71 392892 2389036 4 02:11:02 AM 4724904 6989104 3157524 40.06 2688 2433600 777996 8.71 392892 2389268 100 02:12:01 AM 4724700 6988908 3157728 40.06 2688 2433608 777996 8.71 392892 2389396 8 02:13:01 AM 4723968 6988268 3158460 40.07 2688 2433700 777996 8.71 392892 2390032 104 02:14:01 AM 4724080 6988380 3158348 40.07 2688 2433700 777996 8.71 392892 2389928 4 02:15:01 AM 4723448 6987848 3158980 40.08 2688 2433800 777996 8.71 392892 2390664 104 02:16:01 AM 4721864 6986456 3160564 40.10 2688 2433992 777996 8.71 392892 2392304 184 02:17:01 AM 4721096 6986044 3161332 40.11 2688 2434348 777996 8.71 392892 2393084 4 02:18:01 AM 4720848 6986152 3161580 40.11 2688 2434712 777996 8.71 392892 2393324 160 02:19:01 AM 4720500 6986148 3161928 40.11 2688 2435048 777996 8.71 392892 2393784 88 02:20:01 AM 4719888 6985892 3162540 40.12 2688 2435404 780968 8.74 392892 2394192 80 02:21:01 AM 4719588 6985948 3162840 40.13 2688 2435768 780968 8.74 392892 2394512 168 02:22:01 AM 4719376 6986056 3163052 40.13 2688 2436080 780968 8.74 392892 2394764 4 02:23:01 AM 4719308 6986096 3163120 40.13 2688 2436188 780968 8.74 392892 2394880 4 02:24:01 AM 4718892 6985684 3163536 40.13 2688 2436192 780968 8.74 392892 2395244 16 02:25:01 AM 4719060 6985948 3163368 40.13 2688 2436284 796836 8.92 392892 2395000 104 02:26:01 AM 4718952 6985840 3163476 40.13 2688 2436284 796836 8.92 392892 2395184 4 02:27:01 AM 4718984 6985968 3163444 40.13 2688 2436380 796836 8.92 392892 2395096 100 02:28:01 AM 4719048 6986032 3163380 40.13 2688 2436380 796836 8.92 392892 2395096 4 02:29:01 AM 4718268 6985344 3164160 40.14 2688 2436472 796836 8.92 392892 2395716 100 02:30:01 AM 4718500 6985580 3163928 40.14 2688 2436476 789192 8.84 392892 2395496 12 02:31:01 AM 4718536 6985708 3163892 40.14 2688 2436568 789192 8.84 392892 2395564 104 02:32:01 AM 4718400 6985576 3164028 40.14 2688 2436572 789192 8.84 392892 2395620 4 02:33:01 AM 4718296 6985564 3164132 40.14 2688 2436664 789192 8.84 392892 2395600 104 02:34:01 AM 4718404 6985672 3164024 40.14 2688 2436664 789192 8.84 392892 2395668 4 02:35:01 AM 4718508 6985876 3163920 40.14 2688 2436764 789192 8.84 392892 2395604 104 02:36:01 AM 4718252 6985824 3164176 40.14 2688 2436968 789192 8.84 392892 2395760 196 02:37:01 AM 4718008 6985932 3164420 40.15 2688 2437328 789192 8.84 392892 2396092 80 02:38:01 AM 4717672 6985960 3164756 40.15 2688 2437684 789192 8.84 392892 2396456 48 02:39:01 AM 4717308 6985936 3165120 40.15 2688 2438024 789192 8.84 392892 2396796 148 02:40:01 AM 4716524 6985504 3165904 40.16 2688 2438384 781000 8.74 392892 2397264 88 02:41:01 AM 4716464 6985808 3165964 40.16 2688 2438748 781000 8.74 392892 2397588 24 02:42:01 AM 4716084 6985744 3166344 40.17 2688 2439056 781000 8.74 392892 2397836 4 02:43:01 AM 4716068 6985840 3166360 40.17 2688 2439168 781000 8.74 392892 2397956 4 02:44:01 AM 4715960 6985736 3166468 40.17 2688 2439172 796716 8.92 392892 2398100 4 02:45:01 AM 4716004 6985872 3166424 40.17 2688 2439264 796716 8.92 392892 2398192 4 02:46:01 AM 4715968 6985836 3166460 40.17 2688 2439264 796716 8.92 392892 2398204 4 02:47:01 AM 4715380 6985344 3167048 40.18 2688 2439360 796716 8.92 392892 2398632 112 02:48:01 AM 4715848 6985812 3166580 40.17 2688 2439360 796716 8.92 392892 2398268 8 02:49:01 AM 4715852 6985908 3166576 40.17 2688 2439452 796716 8.92 392892 2398260 100 02:50:01 AM 4715620 6985680 3166808 40.18 2688 2439456 790772 8.85 392892 2398380 4 02:51:01 AM 4715556 6985708 3166872 40.18 2688 2439548 790772 8.85 392892 2398428 100 02:52:01 AM 4715644 6985800 3166784 40.18 2688 2439552 790772 8.85 392892 2398364 4 02:53:01 AM 4715440 6985688 3166988 40.18 2688 2439644 790772 8.85 392892 2398572 100 02:54:01 AM 4713568 6983816 3168860 40.20 2688 2439644 789272 8.84 392892 2400668 16 02:55:01 AM 4715360 6985828 3167068 40.18 2688 2439856 781280 8.75 397012 2394528 176 02:56:01 AM 4715196 6985856 3167232 40.18 2688 2440056 781280 8.75 397012 2394832 136 02:57:01 AM 4714840 6985856 3167588 40.19 2688 2440404 781280 8.75 397012 2395120 64 02:58:01 AM 4714064 6985436 3168364 40.20 2688 2440760 781280 8.75 397012 2395688 44 02:59:01 AM 4714084 6985808 3168344 40.20 2688 2441112 781280 8.75 397012 2395892 60 03:00:01 AM 4713388 6985444 3169040 40.20 2688 2441452 777316 8.70 397012 2396356 56 03:01:01 AM 4712264 6984668 3170164 40.22 2688 2441792 777316 8.70 397012 2397472 120 03:02:01 AM 4712488 6985332 3169940 40.22 2688 2442232 777316 8.70 397016 2397288 112 03:03:01 AM 4712216 6985492 3170212 40.22 2688 2442672 777316 8.70 397016 2397684 112 03:04:01 AM 4711976 6985264 3170452 40.22 2688 2442676 777316 8.70 397016 2397816 4 03:05:01 AM 4712208 6985496 3170220 40.22 2688 2442684 777316 8.70 397016 2397764 16 03:06:01 AM 4712372 6985736 3170056 40.22 2688 2442752 777316 8.70 397016 2397640 4 03:07:01 AM 4712396 6985764 3170032 40.22 2688 2442756 777316 8.70 397016 2397576 4 03:08:01 AM 4712460 6985908 3169968 40.22 2688 2442836 777316 8.70 397016 2397656 4 03:09:01 AM 4711980 6985428 3170448 40.22 2688 2442836 777316 8.70 397016 2397772 4 03:10:01 AM 4711756 6985376 3170672 40.22 2688 2443008 772052 8.64 397016 2397832 4 03:11:02 AM 4711948 6985636 3170480 40.22 2688 2443072 772052 8.64 397016 2398092 16 03:12:01 AM 4711948 6985700 3170480 40.22 2688 2443136 772052 8.64 397016 2398096 4 03:13:01 AM 4711980 6985732 3170448 40.22 2688 2443136 772052 8.64 397016 2398096 4 03:14:01 AM 4711800 6985692 3170628 40.22 2688 2443276 772052 8.64 397016 2398124 84 03:15:01 AM 4711324 6985588 3171104 40.23 2688 2443648 787464 8.82 397016 2398484 16 03:16:01 AM 4710864 6985488 3171564 40.24 2688 2444008 787464 8.82 397016 2398912 176 03:17:01 AM 4710676 6985632 3171752 40.24 2688 2444348 787464 8.82 397016 2399184 132 03:18:01 AM 4710340 6985652 3172088 40.24 2688 2444696 787464 8.82 397016 2399540 4 03:19:01 AM 4710216 6985864 3172212 40.24 2688 2445040 787464 8.82 397016 2399876 152 03:20:01 AM 4709204 6985192 3173224 40.26 2688 2445380 789288 8.84 397016 2400456 56 03:21:01 AM 4709600 6985704 3172828 40.25 2688 2445488 789288 8.84 397016 2400408 4 03:22:01 AM 4709412 6985756 3173016 40.25 2688 2445728 789288 8.84 397016 2400620 144 03:23:01 AM 4708796 6985488 3173632 40.26 2688 2446076 789288 8.84 397016 2401084 24 03:24:01 AM 4708428 6985452 3174000 40.27 2688 2446416 789288 8.84 397016 2401416 40 03:25:01 AM 4708224 6985592 3174204 40.27 2688 2446760 789288 8.84 397016 2401760 96 03:26:01 AM 4707788 6985520 3174640 40.27 2688 2447116 789288 8.84 397016 2402076 88 03:27:01 AM 4707600 6985676 3174828 40.28 2688 2447456 789288 8.84 397016 2402348 16 03:28:01 AM 4707112 6985564 3175316 40.28 2688 2447832 789288 8.84 397016 2402724 128 03:29:01 AM 4707004 6985700 3175424 40.28 2688 2448076 789288 8.84 397016 2403068 240 03:30:01 AM 4706564 6985496 3175864 40.29 2688 2448312 781096 8.75 397016 2403304 112 03:31:01 AM 4706300 6985572 3176128 40.29 2688 2448660 781096 8.75 397016 2403712 64 03:32:01 AM 4705716 6985332 3176712 40.30 2688 2449004 781096 8.75 397016 2404136 100 03:33:01 AM 4705384 6985356 3177044 40.31 2688 2449352 781096 8.75 397016 2404444 32 03:34:01 AM 4705384 6985708 3177044 40.31 2688 2449700 781096 8.75 397016 2404592 24 03:35:01 AM 4705028 6985692 3177400 40.31 2688 2450044 781096 8.75 397016 2405048 4 03:36:01 AM 4704124 6985440 3178304 40.32 2688 2450692 781096 8.75 397016 2405768 456 03:37:01 AM 4704132 6985596 3178296 40.32 2688 2450840 781096 8.75 397016 2405736 4 03:38:01 AM 4704172 6985640 3178256 40.32 2688 2450844 781096 8.75 397024 2405816 4 03:39:01 AM 4704188 6985736 3178240 40.32 2688 2450924 781096 8.75 397016 2405820 88 03:40:01 AM 4703664 6985212 3178764 40.33 2688 2450924 796480 8.92 397016 2406056 4 03:41:01 AM 4703960 6985520 3178468 40.32 2688 2450936 779956 8.73 397016 2405996 16 03:42:01 AM 4703876 6985504 3178552 40.32 2688 2451004 779956 8.73 397016 2405904 4 03:43:01 AM 4703972 6985604 3178456 40.32 2688 2451008 779956 8.73 397016 2406024 4 03:44:01 AM 4703748 6985564 3178680 40.33 2688 2451192 779956 8.73 397016 2406220 24 03:45:01 AM 4703536 6985532 3178892 40.33 2688 2451372 779956 8.73 397024 2406276 4 03:46:01 AM 4703452 6985452 3178976 40.33 2688 2451376 779956 8.73 397024 2406348 4 03:47:01 AM 4703076 6985116 3179352 40.33 2688 2451416 779956 8.73 397024 2406592 4 03:48:01 AM 4703300 6985404 3179128 40.33 2688 2451480 779956 8.73 397024 2406384 16 03:49:01 AM 4703432 6985636 3178996 40.33 2688 2451580 779956 8.73 397024 2406484 56 03:50:01 AM 4702536 6984804 3179892 40.34 2688 2451644 798164 8.94 397024 2406896 16 03:51:01 AM 4702972 6985384 3179456 40.34 2688 2451788 798164 8.94 397028 2406756 4 03:52:01 AM 4703092 6985504 3179336 40.33 2688 2451788 798164 8.94 397028 2406688 4 03:53:01 AM 4702956 6985512 3179472 40.34 2688 2451932 798164 8.94 397028 2406944 4 03:54:01 AM 4702548 6985440 3179880 40.34 2688 2452268 798164 8.94 397028 2407444 128 03:55:01 AM 4702648 6985876 3179780 40.34 2688 2452612 798164 8.94 397028 2407508 96 03:56:01 AM 4701908 6985476 3180520 40.35 2688 2452952 798164 8.94 397028 2408052 60 03:57:01 AM 4701672 6985588 3180756 40.35 2688 2453300 798164 8.94 397028 2408196 196 03:58:01 AM 4701140 6985400 3181288 40.36 2688 2453644 798164 8.94 397028 2408684 140 03:59:01 AM 4700872 6985472 3181556 40.36 2688 2453976 781504 8.75 397028 2409100 72 04:00:01 AM 4699548 6984764 3182880 40.38 2688 2454588 802552 8.99 397028 2410068 8 04:01:01 AM 4698740 6984076 3183688 40.39 2688 2454708 802552 8.99 397028 2410452 4 04:02:01 AM 4700000 6985340 3182428 40.37 2688 2454712 802552 8.99 397032 2409784 4 04:03:01 AM 4700184 6985604 3182244 40.37 2688 2454792 802552 8.99 397032 2409748 4 04:04:01 AM 4699972 6985392 3182456 40.37 2688 2454792 802552 8.99 397032 2409864 4 04:05:01 AM 4700044 6985544 3182384 40.37 2688 2454872 802552 8.99 397032 2409828 84 04:06:01 AM 4700192 6985692 3182236 40.37 2688 2454872 802552 8.99 397032 2409900 4 04:07:01 AM 4699824 6985432 3182604 40.38 2688 2454976 785944 8.80 397032 2410040 112 04:08:01 AM 4699812 6985536 3182616 40.38 2688 2455092 785944 8.80 397032 2410052 4 04:09:01 AM 4699820 6985696 3182608 40.38 2688 2455244 785944 8.80 397032 2410204 4 04:10:01 AM 4699412 6985288 3183016 40.38 2688 2455244 787496 8.82 397032 2410320 4 04:11:01 AM 4699204 6985128 3183224 40.38 2688 2455288 787496 8.82 397032 2410436 48 04:12:01 AM 4699380 6985392 3183048 40.38 2688 2455376 787496 8.82 397040 2410448 4 04:13:01 AM 4699324 6985436 3183104 40.38 2688 2455476 787496 8.82 397040 2410548 68 04:14:01 AM 4699080 6985260 3183348 40.39 2688 2455544 787496 8.82 397040 2410708 8 04:15:01 AM 4698688 6985000 3183740 40.39 2688 2455676 787496 8.82 397040 2410996 4 04:16:01 AM 4698748 6985060 3183680 40.39 2688 2455676 787496 8.82 397040 2410840 4 04:17:01 AM 4698868 6985324 3183560 40.39 2688 2455820 787496 8.82 397040 2410800 4 04:18:01 AM 4698668 6985516 3183760 40.39 2688 2456212 787496 8.82 397040 2411208 144 04:19:01 AM 4698336 6985528 3184092 40.39 2688 2456556 787496 8.82 397040 2411668 88 04:20:01 AM 4697704 6985240 3184724 40.40 2688 2456900 781160 8.75 397040 2412012 192 04:21:01 AM 4697496 6985380 3184932 40.41 2688 2457248 801648 8.98 397388 2411964 136 04:22:01 AM 4697024 6985260 3185404 40.41 2688 2457600 801648 8.98 397388 2412368 48 04:23:01 AM 4696908 6985492 3185520 40.41 2688 2457956 801648 8.98 397388 2412600 208 04:24:01 AM 4696464 6985604 3185964 40.42 2688 2458512 801648 8.98 397388 2413156 20 04:25:01 AM 4696064 6985284 3186364 40.42 2688 2458584 801648 8.98 397388 2413240 4 04:26:01 AM 4696048 6985272 3186380 40.42 2688 2458588 801648 8.98 397388 2413276 4 04:27:01 AM 4696164 6985468 3186264 40.42 2688 2458668 801648 8.98 397388 2413324 4 04:28:01 AM 4695936 6985240 3186492 40.43 2688 2458668 801648 8.98 397388 2413440 4 04:29:01 AM 4696088 6985472 3186340 40.42 2688 2458748 801648 8.98 397388 2413388 4 04:30:01 AM 4695356 6984740 3187072 40.43 2688 2458748 801648 8.98 397388 2413756 4 04:31:01 AM 4695828 6985352 3186600 40.43 2688 2458888 779496 8.73 397388 2413604 4 04:32:01 AM 4695512 6985116 3186916 40.43 2688 2458968 779496 8.73 397388 2413760 4 04:33:01 AM 4695364 6985112 3187064 40.43 2688 2459112 779496 8.73 397392 2414084 4 04:34:01 AM 4695508 6985260 3186920 40.43 2688 2459116 794872 8.90 397392 2413772 4 04:35:01 AM 4695580 6985388 3186848 40.43 2688 2459172 794872 8.90 397392 2413944 16 04:36:01 AM 4695404 6985212 3187024 40.43 2688 2459172 794872 8.90 397392 2413904 4 04:37:01 AM 4695348 6985348 3187080 40.43 2688 2459364 794872 8.90 397396 2414024 4 04:38:01 AM 4695360 6985360 3187068 40.43 2688 2459364 794872 8.90 397396 2414024 4 04:39:01 AM 4695120 6985224 3187308 40.44 2688 2459468 794872 8.90 397396 2414236 112 04:40:01 AM 4694676 6984952 3187752 40.44 2688 2459640 809520 9.06 397396 2414648 136 04:41:01 AM 4694612 6985216 3187816 40.44 2688 2459988 790060 8.85 397396 2414840 32 04:42:01 AM 4694628 6985576 3187800 40.44 2688 2460336 790060 8.85 397396 2415112 24 04:43:01 AM 4693984 6985292 3188444 40.45 2688 2460696 790060 8.85 397396 2415356 24 04:44:01 AM 4693860 6985516 3188568 40.45 2688 2461044 790060 8.85 397396 2415704 40 04:45:01 AM 4693420 6985432 3189008 40.46 2688 2461392 790060 8.85 397396 2416176 24 04:46:01 AM 4692832 6985240 3189596 40.46 2688 2461788 790060 8.85 397396 2416536 60 04:47:01 AM 4692072 6984996 3190356 40.47 2688 2462304 790060 8.85 397396 2417300 4 04:48:02 AM 4692524 6985524 3189904 40.47 2688 2462380 790060 8.85 397396 2417060 4 04:49:01 AM 4692372 6985372 3190056 40.47 2688 2462380 790060 8.85 397396 2417176 4 04:50:01 AM 4692108 6985188 3190320 40.47 2688 2462460 789472 8.84 397396 2417256 4 04:51:01 AM 4692088 6985176 3190340 40.47 2688 2462464 789472 8.84 397396 2417216 12 04:52:01 AM 4692180 6985344 3190248 40.47 2688 2462540 789472 8.84 397396 2417224 4 04:53:01 AM 4692016 6985180 3190412 40.47 2688 2462540 789472 8.84 397396 2417360 12 04:54:01 AM 4691732 6985068 3190696 40.48 2688 2462712 789472 8.84 397396 2417712 176 04:55:01 AM 4691804 6985332 3190624 40.48 2688 2462904 808780 9.06 397396 2417648 4 04:56:01 AM 4688880 6982588 3193548 40.51 2688 2463084 824608 9.23 397400 2420140 72 04:57:01 AM 4688276 6982180 3194152 40.52 2688 2463280 842544 9.43 397400 2420620 48 04:58:01 AM 4685456 6979696 3196972 40.56 2688 2463616 880424 9.86 397400 2423116 4 04:59:01 AM 4684828 6979292 3197600 40.57 2688 2463840 898360 10.06 397400 2423540 16 05:00:01 AM 4683132 6978248 3199296 40.59 2688 2464472 957444 10.72 397400 2424576 312 05:01:01 AM 4448136 6745016 3434292 43.57 2688 2466260 1199100 13.43 397400 2658816 1752 05:02:01 AM 4699488 6903188 3182940 40.38 2688 2378324 764100 8.56 477368 2350944 13196 05:03:01 AM 4700576 6909456 3181852 40.37 2688 2383908 764868 8.56 635140 2193616 15936 Average: 4718734 6986169 3163694 40.14 2688 2436867 788176 8.83 393923 2394361 160 12:00:02 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:01:01 AM eth0 9.81 9.83 2.12 1.87 0.00 0.00 0.00 0.00 12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:02:01 AM eth0 12.04 11.79 2.73 2.13 0.00 0.00 0.00 0.00 12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:03:01 AM eth0 1.28 0.28 0.34 0.19 0.00 0.00 0.00 0.00 12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:04:01 AM eth0 0.23 0.00 0.01 0.00 0.00 0.00 0.00 0.00 12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:05:01 AM eth0 0.75 0.32 0.09 0.04 0.00 0.00 0.00 0.00 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:06:01 AM eth0 0.48 0.15 0.10 0.07 0.00 0.00 0.00 0.00 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:07:01 AM eth0 1.42 0.53 0.39 0.24 0.00 0.00 0.00 0.00 12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:08:01 AM eth0 0.17 0.05 0.01 0.00 0.00 0.00 0.00 0.00 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:09:01 AM eth0 7.73 7.66 1.62 0.93 0.00 0.00 0.00 0.00 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:10:01 AM eth0 2.98 2.75 0.54 0.23 0.00 0.00 0.00 0.00 12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:11:01 AM eth0 2.87 0.72 0.47 0.16 0.00 0.00 0.00 0.00 12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:12:01 AM eth0 0.42 0.15 0.02 0.01 0.00 0.00 0.00 0.00 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:13:01 AM eth0 0.37 0.05 0.02 0.00 0.00 0.00 0.00 0.00 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:14:01 AM eth0 0.25 0.00 0.01 0.00 0.00 0.00 0.00 0.00 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:15:01 AM eth0 4.20 3.82 0.83 0.50 0.00 0.00 0.00 0.00 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:16:01 AM eth0 11.06 10.46 2.57 2.17 0.00 0.00 0.00 0.00 12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:17:01 AM eth0 9.40 9.48 1.99 1.77 0.00 0.00 0.00 0.00 12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:18:01 AM eth0 9.53 9.65 2.02 1.81 0.00 0.00 0.00 0.00 12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:19:01 AM eth0 9.50 9.77 2.02 1.81 0.00 0.00 0.00 0.00 12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:01 AM eth0 9.61 9.75 2.03 1.81 0.00 0.00 0.00 0.00 12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 AM eth0 9.60 9.70 2.10 1.87 0.00 0.00 0.00 0.00 12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:22:01 AM eth0 2.38 2.13 0.41 0.39 0.00 0.00 0.00 0.00 12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:23:01 AM eth0 0.33 0.07 0.02 0.00 0.00 0.00 0.00 0.00 12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:24:01 AM eth0 3.17 0.00 0.21 0.00 0.00 0.00 0.00 0.00 12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 AM eth0 2.48 2.22 0.44 0.41 0.00 0.00 0.00 0.00 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 AM eth0 10.63 10.28 2.35 2.01 0.00 0.00 0.00 0.00 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 AM eth0 9.73 9.67 2.39 1.95 0.00 0.00 0.00 0.00 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 AM eth0 9.56 9.70 2.03 1.81 0.00 0.00 0.00 0.00 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 AM eth0 9.90 9.72 2.10 1.81 0.00 0.00 0.00 0.00 12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:01 AM eth0 9.48 9.66 2.02 1.81 0.00 0.00 0.00 0.00 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 AM eth0 9.65 9.75 2.10 1.87 0.00 0.00 0.00 0.00 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 AM eth0 13.58 12.93 3.02 2.37 0.00 0.00 0.00 0.00 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 AM eth0 0.90 0.55 0.33 0.24 0.00 0.00 0.00 0.00 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 AM eth0 1.93 0.32 0.53 0.26 0.00 0.00 0.00 0.00 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 AM eth0 0.77 0.48 0.32 0.24 0.00 0.00 0.00 0.00 12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:01 AM eth0 0.42 0.15 0.09 0.07 0.00 0.00 0.00 0.00 12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 AM eth0 0.45 0.38 0.07 0.05 0.00 0.00 0.00 0.00 12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:01 AM eth0 8.38 8.35 1.57 0.98 0.00 0.00 0.00 0.00 12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 AM eth0 3.25 2.82 0.65 0.24 0.00 0.00 0.00 0.00 12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 AM eth0 1.23 0.60 0.25 0.15 0.00 0.00 0.00 0.00 12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 AM eth0 1.32 0.27 0.42 0.25 0.00 0.00 0.00 0.00 12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 AM eth0 2.92 2.23 0.85 0.44 0.00 0.00 0.00 0.00 12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 AM eth0 11.05 10.68 2.54 2.15 0.00 0.00 0.00 0.00 12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 AM eth0 9.77 9.70 2.06 1.81 0.00 0.00 0.00 0.00 12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:01 AM eth0 10.68 10.10 2.71 2.14 0.00 0.00 0.00 0.00 12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 AM eth0 9.73 9.78 2.50 2.17 0.00 0.00 0.00 0.00 12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 AM eth0 9.27 9.43 1.96 1.75 0.00 0.00 0.00 0.00 12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 AM eth0 9.45 9.67 2.04 1.81 0.00 0.00 0.00 0.00 12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:01 AM eth0 3.02 2.90 0.59 0.54 0.00 0.00 0.00 0.00 12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 AM eth0 2.95 2.98 0.62 0.61 0.00 0.00 0.00 0.00 12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 AM eth0 9.43 9.65 2.00 1.79 0.00 0.00 0.00 0.00 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 9.85 9.68 2.11 1.81 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 9.63 9.83 2.03 1.82 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 9.43 9.63 2.02 1.81 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 9.30 9.42 2.02 1.80 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 10.45 9.90 2.44 2.06 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 3.05 2.78 0.51 0.51 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 5.45 5.55 1.12 1.02 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 9.24 9.39 1.98 1.76 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 9.55 9.73 2.07 1.85 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 9.45 9.63 2.02 1.80 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 10.48 9.91 2.36 2.00 0.00 0.00 0.00 0.00 01:04:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:02 AM eth0 10.16 9.68 2.46 1.98 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 19.73 18.62 4.52 3.57 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 1.18 0.67 0.44 0.32 0.00 0.00 0.00 0.00 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 AM eth0 1.30 0.00 0.16 0.00 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 0.87 0.48 0.33 0.24 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 5.85 0.15 0.71 0.07 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 2.38 0.65 0.99 0.58 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 1.38 0.78 0.72 0.50 0.00 0.00 0.00 0.00 01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:01 AM eth0 1.68 0.02 0.20 0.00 0.00 0.00 0.00 0.00 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 AM eth0 13.91 7.28 2.34 0.91 0.00 0.00 0.00 0.00 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 AM eth0 4.90 3.70 1.02 0.53 0.00 0.00 0.00 0.00 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 AM eth0 0.57 0.00 0.03 0.00 0.00 0.00 0.00 0.00 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 AM eth0 2.52 1.92 0.52 0.21 0.00 0.00 0.00 0.00 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 AM eth0 6.76 5.93 1.29 1.08 0.00 0.00 0.00 0.00 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 AM eth0 10.53 9.57 2.10 1.80 0.00 0.00 0.00 0.00 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 AM eth0 10.31 9.48 2.07 1.77 0.00 0.00 0.00 0.00 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 AM eth0 10.03 9.50 2.04 1.78 0.00 0.00 0.00 0.00 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 AM eth0 9.71 9.88 2.10 1.88 0.00 0.00 0.00 0.00 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 AM eth0 9.51 9.63 2.02 1.81 0.00 0.00 0.00 0.00 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 AM eth0 10.21 8.42 2.00 1.62 0.00 0.00 0.00 0.00 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 AM eth0 5.35 2.38 1.16 0.66 0.00 0.00 0.00 0.00 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 AM eth0 4.60 4.38 1.31 1.12 0.00 0.00 0.00 0.00 01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:01 AM eth0 9.43 9.48 2.05 1.83 0.00 0.00 0.00 0.00 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 AM eth0 17.26 9.48 3.13 1.81 0.00 0.00 0.00 0.00 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 AM eth0 10.40 9.58 2.26 1.94 0.00 0.00 0.00 0.00 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 AM eth0 9.87 9.68 2.04 1.81 0.00 0.00 0.00 0.00 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 AM eth0 9.63 9.70 2.03 1.81 0.00 0.00 0.00 0.00 01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:01 AM eth0 15.58 15.48 3.60 2.92 0.00 0.00 0.00 0.00 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 AM eth0 5.98 4.75 1.09 0.87 0.00 0.00 0.00 0.00 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 AM eth0 0.53 0.18 0.26 0.19 0.00 0.00 0.00 0.00 01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 AM eth0 0.30 0.05 0.03 0.00 0.00 0.00 0.00 0.00 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM eth0 1.37 0.32 0.16 0.04 0.00 0.00 0.00 0.00 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 AM eth0 1.03 0.27 0.29 0.11 0.00 0.00 0.00 0.00 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 AM eth0 0.45 0.33 0.08 0.05 0.00 0.00 0.00 0.00 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 AM eth0 0.28 0.05 0.01 0.00 0.00 0.00 0.00 0.00 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 AM eth0 7.62 7.62 1.50 0.93 0.00 0.00 0.00 0.00 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 AM eth0 3.35 3.23 0.68 0.32 0.00 0.00 0.00 0.00 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 AM eth0 0.45 0.15 0.09 0.07 0.00 0.00 0.00 0.00 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 AM eth0 0.42 0.13 0.02 0.01 0.00 0.00 0.00 0.00 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 AM eth0 0.73 0.25 0.17 0.03 0.00 0.00 0.00 0.00 01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:01 AM eth0 0.33 0.00 0.02 0.00 0.00 0.00 0.00 0.00 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 AM eth0 1.13 0.33 0.22 0.04 0.00 0.00 0.00 0.00 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 AM eth0 0.32 0.10 0.08 0.06 0.00 0.00 0.00 0.00 01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:01 AM eth0 0.88 0.48 0.44 0.22 0.00 0.00 0.00 0.00 01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:01 AM eth0 0.30 0.00 0.04 0.00 0.00 0.00 0.00 0.00 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 AM eth0 0.47 0.25 0.08 0.03 0.00 0.00 0.00 0.00 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 AM eth0 0.62 0.42 0.16 0.10 0.00 0.00 0.00 0.00 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 AM eth0 0.42 0.27 0.08 0.03 0.00 0.00 0.00 0.00 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 AM eth0 0.20 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 AM eth0 2.28 2.05 0.42 0.18 0.00 0.00 0.00 0.00 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 AM eth0 8.83 8.96 1.92 1.72 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 9.47 9.68 2.03 1.81 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 9.65 9.71 2.03 1.81 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 9.40 9.68 2.02 1.81 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 9.50 9.73 2.02 1.81 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 9.51 9.78 2.09 1.87 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 4.96 4.41 0.96 0.82 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 1.07 0.73 0.32 0.27 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 1.20 0.17 0.32 0.19 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 0.33 0.20 0.02 0.02 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 0.40 0.12 0.09 0.06 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 0.47 0.18 0.04 0.02 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 0.20 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 0.32 0.22 0.02 0.02 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 0.57 0.00 0.11 0.00 0.00 0.00 0.00 0.00 02:11:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:02 AM eth0 1.38 0.43 0.28 0.15 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 1.00 0.47 0.81 0.40 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 0.35 0.20 0.03 0.02 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 0.25 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 0.30 0.17 0.03 0.06 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 5.53 5.47 1.19 1.06 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 9.28 9.47 1.98 1.75 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 9.50 9.70 2.04 1.81 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 9.22 9.20 1.99 1.73 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 9.35 9.70 2.01 1.81 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 9.55 9.71 2.09 1.87 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 7.00 7.23 1.48 1.34 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 0.53 0.45 0.06 0.07 0.00 0.00 0.00 0.00 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 AM eth0 0.95 0.22 0.31 0.19 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 0.28 0.20 0.01 0.02 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 0.32 0.17 0.09 0.07 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 0.25 0.18 0.01 0.02 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 1.05 0.00 0.12 0.00 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 0.62 0.40 0.27 0.21 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 4.72 0.12 0.56 0.07 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 3.05 0.70 1.02 0.47 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 1.67 0.50 0.68 0.45 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 2.70 0.47 0.61 0.28 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 6.20 0.18 1.02 0.19 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 1.12 0.18 0.08 0.06 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 6.50 6.10 1.36 1.15 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 9.26 9.28 1.95 1.74 0.00 0.00 0.00 0.00 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 AM eth0 10.08 9.66 2.07 1.81 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 10.56 9.68 2.11 1.81 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 10.38 9.46 2.08 1.79 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 9.55 9.65 2.06 1.83 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 7.20 7.22 1.49 1.34 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 0.68 0.53 0.07 0.08 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 2.72 0.15 0.35 0.07 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 0.77 0.35 0.33 0.20 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 0.33 0.07 0.09 0.06 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 1.60 0.48 0.46 0.27 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 3.00 0.20 0.59 0.19 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 0.57 0.20 0.03 0.02 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 0.33 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 AM eth0 0.55 0.35 0.10 0.08 0.00 0.00 0.00 0.00 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 AM eth0 0.40 0.05 0.02 0.00 0.00 0.00 0.00 0.00 02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:01 AM eth0 0.52 0.18 0.02 0.02 0.00 0.00 0.00 0.00 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 AM eth0 1.63 0.30 0.47 0.26 0.00 0.00 0.00 0.00 02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:01 AM eth0 4.02 3.50 1.54 0.49 0.00 0.00 0.00 0.00 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 AM eth0 4.00 3.60 0.79 0.71 0.00 0.00 0.00 0.00 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 AM eth0 12.78 9.63 2.45 1.81 0.00 0.00 0.00 0.00 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 AM eth0 10.90 9.82 2.64 2.05 0.00 0.00 0.00 0.00 02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:01 AM eth0 9.45 9.42 1.97 1.75 0.00 0.00 0.00 0.00 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 9.36 9.24 1.96 1.73 0.00 0.00 0.00 0.00 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 AM eth0 10.14 9.51 2.10 1.81 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 12.81 11.79 2.70 2.29 0.00 0.00 0.00 0.00 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 AM eth0 9.23 8.55 2.31 1.68 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 2.40 0.38 0.60 0.27 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 0.57 0.12 0.27 0.18 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 1.10 0.55 0.26 0.12 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 2.87 0.02 0.36 0.00 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 0.73 0.38 0.10 0.05 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 0.38 0.05 0.02 0.00 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 8.48 8.38 1.57 0.99 0.00 0.00 0.00 0.00 03:11:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:02 AM eth0 3.65 3.38 0.72 0.37 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 0.59 0.36 0.09 0.04 0.00 0.00 0.00 0.00 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 AM eth0 0.23 0.10 0.01 0.00 0.00 0.00 0.00 0.00 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 AM eth0 3.90 3.82 0.84 0.54 0.00 0.00 0.00 0.00 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 AM eth0 10.16 10.36 2.17 1.94 0.00 0.00 0.00 0.00 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 AM eth0 9.53 9.50 2.04 1.81 0.00 0.00 0.00 0.00 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 AM eth0 9.01 9.33 1.94 1.74 0.00 0.00 0.00 0.00 03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:18:01 AM eth0 9.17 9.27 1.95 1.73 0.00 0.00 0.00 0.00 03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 AM eth0 9.07 9.25 1.94 1.73 0.00 0.00 0.00 0.00 03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 AM eth0 9.23 9.33 2.00 1.74 0.00 0.00 0.00 0.00 03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:21:01 AM eth0 1.90 1.73 0.39 0.37 0.00 0.00 0.00 0.00 03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:22:01 AM eth0 4.37 4.20 0.99 0.76 0.00 0.00 0.00 0.00 03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:23:01 AM eth0 9.28 9.51 1.97 1.77 0.00 0.00 0.00 0.00 03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:24:01 AM eth0 9.11 9.23 1.95 1.73 0.00 0.00 0.00 0.00 03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:25:01 AM eth0 9.10 9.35 1.95 1.76 0.00 0.00 0.00 0.00 03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:26:01 AM eth0 9.60 9.72 2.07 1.83 0.00 0.00 0.00 0.00 03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:27:01 AM eth0 9.00 9.40 1.93 1.74 0.00 0.00 0.00 0.00 03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:28:01 AM eth0 8.62 8.70 1.80 1.62 0.00 0.00 0.00 0.00 03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:29:01 AM eth0 2.22 2.13 0.39 0.40 0.00 0.00 0.00 0.00 03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:30:01 AM eth0 6.50 6.65 1.36 1.23 0.00 0.00 0.00 0.00 03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:31:01 AM eth0 9.31 9.45 2.02 1.80 0.00 0.00 0.00 0.00 03:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:32:01 AM eth0 9.75 9.37 2.08 1.80 0.00 0.00 0.00 0.00 03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:33:01 AM eth0 9.28 9.53 2.19 1.93 0.00 0.00 0.00 0.00 03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:34:01 AM eth0 9.18 9.33 1.95 1.74 0.00 0.00 0.00 0.00 03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:35:01 AM eth0 8.96 9.25 1.93 1.73 0.00 0.00 0.00 0.00 03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:36:01 AM eth0 17.23 16.69 3.86 3.15 0.00 0.00 0.00 0.00 03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:37:01 AM eth0 0.60 0.53 0.13 0.08 0.00 0.00 0.00 0.00 03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:38:01 AM eth0 0.12 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:39:01 AM eth0 0.47 0.42 0.07 0.05 0.00 0.00 0.00 0.00 03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:40:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:41:01 AM eth0 0.68 0.20 0.16 0.08 0.00 0.00 0.00 0.00 03:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:42:01 AM eth0 0.38 0.33 0.07 0.05 0.00 0.00 0.00 0.00 03:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:43:01 AM eth0 0.17 0.05 0.01 0.00 0.00 0.00 0.00 0.00 03:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:44:01 AM eth0 7.41 7.43 1.53 0.96 0.00 0.00 0.00 0.00 03:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:45:01 AM eth0 3.10 3.05 0.62 0.27 0.00 0.00 0.00 0.00 03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:01 AM eth0 0.32 0.13 0.08 0.07 0.00 0.00 0.00 0.00 03:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:47:01 AM eth0 2.72 2.53 0.79 0.37 0.00 0.00 0.00 0.00 03:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:48:01 AM eth0 2.22 2.12 0.52 0.20 0.00 0.00 0.00 0.00 03:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:49:01 AM eth0 6.02 6.05 1.13 0.52 0.00 0.00 0.00 0.00 03:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:50:01 AM eth0 3.23 3.12 0.60 0.26 0.00 0.00 0.00 0.00 03:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:51:01 AM eth0 0.77 0.67 0.15 0.16 0.00 0.00 0.00 0.00 03:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:52:01 AM eth0 0.10 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:53:01 AM eth0 6.65 6.38 1.27 0.71 0.00 0.00 0.00 0.00 03:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:54:01 AM eth0 9.29 9.44 2.16 1.92 0.00 0.00 0.00 0.00 03:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:55:01 AM eth0 9.21 9.41 2.27 1.74 0.00 0.00 0.00 0.00 03:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:56:01 AM eth0 10.21 9.71 2.34 2.01 0.00 0.00 0.00 0.00 03:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:57:01 AM eth0 8.99 9.29 1.94 1.74 0.00 0.00 0.00 0.00 03:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:58:01 AM eth0 10.60 9.43 2.19 1.81 0.00 0.00 0.00 0.00 03:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:59:01 AM eth0 13.78 9.48 2.69 1.93 0.00 0.00 0.00 0.00 04:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:00:01 AM eth0 18.35 15.32 4.18 3.12 0.00 0.00 0.00 0.00 04:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:01:01 AM eth0 1.30 0.82 0.80 0.51 0.00 0.00 0.00 0.00 04:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:02:01 AM eth0 0.36 0.00 0.02 0.00 0.00 0.00 0.00 0.00 04:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:03:01 AM eth0 9.38 0.42 1.29 0.05 0.00 0.00 0.00 0.00 04:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:04:01 AM eth0 1.40 0.00 0.09 0.00 0.00 0.00 0.00 0.00 04:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:05:01 AM eth0 0.80 0.35 0.09 0.05 0.00 0.00 0.00 0.00 04:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:06:01 AM eth0 0.58 0.10 0.10 0.06 0.00 0.00 0.00 0.00 04:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:07:01 AM eth0 2.68 2.40 0.56 0.44 0.00 0.00 0.00 0.00 04:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:08:01 AM eth0 9.06 7.73 1.63 0.71 0.00 0.00 0.00 0.00 04:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:09:01 AM eth0 1.82 0.58 0.17 0.10 0.00 0.00 0.00 0.00 04:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:10:01 AM eth0 0.60 0.10 0.04 0.00 0.00 0.00 0.00 0.00 04:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:11:01 AM eth0 3.00 2.73 0.61 0.26 0.00 0.00 0.00 0.00 04:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:12:01 AM eth0 3.42 3.23 0.60 0.32 0.00 0.00 0.00 0.00 04:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:13:01 AM eth0 6.91 5.86 1.15 0.46 0.00 0.00 0.00 0.00 04:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:14:01 AM eth0 8.78 5.28 1.62 0.69 0.00 0.00 0.00 0.00 04:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:15:01 AM eth0 1.30 0.60 0.78 0.59 0.00 0.00 0.00 0.00 04:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:16:01 AM eth0 1.67 0.12 0.28 0.06 0.00 0.00 0.00 0.00 04:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:17:01 AM eth0 13.21 7.13 2.10 0.81 0.00 0.00 0.00 0.00 04:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:18:01 AM eth0 10.94 10.69 2.23 1.97 0.00 0.00 0.00 0.00 04:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:19:01 AM eth0 9.61 9.28 1.99 1.76 0.00 0.00 0.00 0.00 04:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:20:01 AM eth0 9.46 9.30 1.93 1.71 0.00 0.00 0.00 0.00 04:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:21:01 AM eth0 9.64 9.43 2.05 1.80 0.00 0.00 0.00 0.00 04:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:22:01 AM eth0 9.31 9.38 1.98 1.76 0.00 0.00 0.00 0.00 04:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:23:01 AM eth0 9.46 9.56 2.00 1.78 0.00 0.00 0.00 0.00 04:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:24:01 AM eth0 14.01 13.66 3.13 2.47 0.00 0.00 0.00 0.00 04:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:25:01 AM eth0 1.10 0.30 0.13 0.04 0.00 0.00 0.00 0.00 04:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:26:01 AM eth0 0.73 0.15 0.12 0.07 0.00 0.00 0.00 0.00 04:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:27:01 AM eth0 0.63 0.32 0.12 0.04 0.00 0.00 0.00 0.00 04:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:28:01 AM eth0 0.17 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:29:01 AM eth0 0.73 0.47 0.26 0.05 0.00 0.00 0.00 0.00 04:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:30:01 AM eth0 0.28 0.05 0.01 0.00 0.00 0.00 0.00 0.00 04:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:31:01 AM eth0 3.67 3.55 0.85 0.71 0.00 0.00 0.00 0.00 04:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:32:01 AM eth0 8.02 6.92 1.44 0.57 0.00 0.00 0.00 0.00 04:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:33:01 AM eth0 1.17 0.77 0.35 0.29 0.00 0.00 0.00 0.00 04:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:34:01 AM eth0 0.35 0.10 0.02 0.00 0.00 0.00 0.00 0.00 04:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:35:01 AM eth0 1.87 1.73 0.44 0.18 0.00 0.00 0.00 0.00 04:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:36:01 AM eth0 0.48 0.10 0.14 0.06 0.00 0.00 0.00 0.00 04:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:37:01 AM eth0 3.17 2.92 0.61 0.26 0.00 0.00 0.00 0.00 04:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:38:01 AM eth0 1.00 0.07 0.18 0.00 0.00 0.00 0.00 0.00 04:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:39:01 AM eth0 2.42 2.47 0.50 0.46 0.00 0.00 0.00 0.00 04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:01 AM eth0 8.66 8.68 1.54 1.00 0.00 0.00 0.00 0.00 04:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:41:01 AM eth0 9.62 9.78 2.10 1.87 0.00 0.00 0.00 0.00 04:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:42:01 AM eth0 9.12 9.33 1.94 1.74 0.00 0.00 0.00 0.00 04:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:43:01 AM eth0 9.40 9.68 2.02 1.81 0.00 0.00 0.00 0.00 04:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:44:01 AM eth0 9.38 9.63 2.02 1.81 0.00 0.00 0.00 0.00 04:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:45:01 AM eth0 9.15 9.40 1.94 1.74 0.00 0.00 0.00 0.00 04:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:46:01 AM eth0 10.85 11.03 2.37 2.19 0.00 0.00 0.00 0.00 04:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:47:01 AM eth0 10.78 10.26 2.67 2.02 0.00 0.00 0.00 0.00 04:48:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:48:02 AM eth0 0.38 0.25 0.07 0.04 0.00 0.00 0.00 0.00 04:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:49:01 AM eth0 0.22 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:50:01 AM eth0 0.47 0.32 0.07 0.04 0.00 0.00 0.00 0.00 04:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:51:01 AM eth0 0.53 0.27 0.36 0.07 0.00 0.00 0.00 0.00 04:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:52:01 AM eth0 0.48 0.35 0.07 0.05 0.00 0.00 0.00 0.00 04:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:53:01 AM eth0 0.82 0.17 0.16 0.07 0.00 0.00 0.00 0.00 04:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:54:01 AM eth0 8.40 8.31 1.79 1.16 0.00 0.00 0.00 0.00 04:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:55:01 AM eth0 5.80 5.82 1.26 0.82 0.00 0.00 0.00 0.00 04:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:56:01 AM eth0 5.08 5.00 1.29 0.88 0.00 0.00 0.00 0.00 04:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:57:01 AM eth0 5.82 5.80 1.22 0.76 0.00 0.00 0.00 0.00 04:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:58:01 AM eth0 9.40 9.05 3.10 1.14 0.00 0.00 0.00 0.00 04:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:59:01 AM eth0 8.15 8.20 1.59 1.05 0.00 0.00 0.00 0.00 05:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:00:01 AM eth0 8.13 8.10 4.74 1.34 0.00 0.00 0.00 0.00 05:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:01:01 AM eth0 4.95 4.95 2.41 0.52 0.00 0.00 0.00 0.00 05:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:02:01 AM eth0 116.90 87.04 273.52 315.39 0.00 0.00 0.00 0.00 05:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:03:01 AM eth0 16.44 17.16 13.39 8.37 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 5.60 4.97 2.06 1.92 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-547.el8.x86_64 (prd-centos8-robot-2c-8g-16223.novalocal) 04/28/2024 _x86_64_ (2 CPU) 12:00:02 AM CPU %user %nice %system %iowait %steal %idle 12:01:01 AM all 4.17 0.03 0.48 0.08 0.08 95.18 12:01:01 AM 0 5.55 0.05 0.66 0.15 0.09 93.50 12:01:01 AM 1 2.79 0.00 0.29 0.00 0.07 96.85 12:02:01 AM all 4.44 0.00 0.23 0.00 0.05 95.27 12:02:01 AM 0 5.69 0.00 0.28 0.00 0.05 93.97 12:02:01 AM 1 3.19 0.00 0.18 0.00 0.05 96.57 12:03:01 AM all 0.35 0.00 0.06 0.00 0.03 99.56 12:03:01 AM 0 0.10 0.00 0.08 0.00 0.03 99.78 12:03:01 AM 1 0.60 0.00 0.03 0.00 0.03 99.33 12:04:01 AM all 0.33 0.00 0.05 0.00 0.04 99.57 12:04:01 AM 0 0.10 0.00 0.07 0.00 0.05 99.78 12:04:01 AM 1 0.57 0.00 0.03 0.00 0.03 99.37 12:05:01 AM all 0.49 0.00 0.06 0.00 0.03 99.42 12:05:01 AM 0 0.40 0.00 0.07 0.00 0.03 99.50 12:05:01 AM 1 0.58 0.00 0.05 0.00 0.03 99.33 12:06:01 AM all 0.30 0.00 0.07 0.00 0.03 99.60 12:06:01 AM 0 0.08 0.00 0.12 0.00 0.05 99.75 12:06:01 AM 1 0.52 0.00 0.02 0.00 0.02 99.45 12:07:01 AM all 0.50 0.00 0.08 0.00 0.04 99.38 12:07:01 AM 0 0.48 0.00 0.08 0.00 0.03 99.40 12:07:01 AM 1 0.52 0.00 0.07 0.00 0.05 99.37 12:08:01 AM all 0.22 0.00 0.09 0.00 0.03 99.67 12:08:01 AM 0 0.35 0.00 0.08 0.00 0.03 99.53 12:08:01 AM 1 0.08 0.00 0.10 0.00 0.02 99.80 12:09:01 AM all 3.46 0.00 0.26 0.00 0.05 96.22 12:09:01 AM 0 2.31 0.00 0.13 0.00 0.05 97.51 12:09:01 AM 1 4.65 0.00 0.40 0.00 0.05 94.90 12:10:01 AM all 6.13 0.00 3.59 0.01 0.07 90.20 12:10:01 AM 0 0.22 0.00 0.20 0.02 0.07 99.50 12:10:01 AM 1 12.66 0.00 7.35 0.00 0.07 79.92 12:11:01 AM all 1.30 0.00 0.18 0.00 0.04 98.48 12:11:01 AM 0 0.45 0.00 0.12 0.00 0.05 99.38 12:11:01 AM 1 2.17 0.00 0.24 0.00 0.03 97.56 12:11:01 AM CPU %user %nice %system %iowait %steal %idle 12:12:01 AM all 0.35 0.00 0.09 0.01 0.04 99.51 12:12:01 AM 0 0.15 0.00 0.13 0.02 0.05 99.65 12:12:01 AM 1 0.55 0.00 0.05 0.00 0.03 99.37 12:13:01 AM all 0.47 0.00 0.08 0.00 0.04 99.41 12:13:01 AM 0 0.33 0.00 0.10 0.00 0.05 99.52 12:13:01 AM 1 0.60 0.00 0.07 0.00 0.03 99.30 12:14:01 AM all 0.51 0.00 0.08 0.00 0.06 99.36 12:14:01 AM 0 0.37 0.00 0.08 0.00 0.07 99.48 12:14:01 AM 1 0.65 0.00 0.07 0.00 0.05 99.23 12:15:01 AM all 4.58 0.00 1.32 0.00 0.06 94.04 12:15:01 AM 0 1.70 0.00 0.20 0.00 0.07 98.03 12:15:01 AM 1 7.67 0.00 2.53 0.00 0.05 89.74 12:16:01 AM all 4.48 0.00 0.18 0.00 0.07 95.27 12:16:01 AM 0 5.96 0.00 0.22 0.00 0.08 93.74 12:16:01 AM 1 3.00 0.00 0.15 0.00 0.05 96.80 12:17:01 AM all 4.18 0.00 0.18 0.00 0.06 95.58 12:17:01 AM 0 4.20 0.00 0.20 0.00 0.05 95.55 12:17:01 AM 1 4.17 0.00 0.17 0.00 0.07 95.60 12:18:01 AM all 4.26 0.00 0.17 0.00 0.08 95.50 12:18:01 AM 0 4.48 0.00 0.20 0.00 0.08 95.23 12:18:01 AM 1 4.03 0.00 0.13 0.00 0.07 95.77 12:19:01 AM all 4.27 0.00 0.15 0.00 0.07 95.52 12:19:01 AM 0 5.57 0.00 0.15 0.00 0.07 94.21 12:19:01 AM 1 2.96 0.00 0.15 0.00 0.07 96.82 12:20:01 AM all 4.27 0.00 0.18 0.00 0.08 95.47 12:20:01 AM 0 4.80 0.00 0.18 0.00 0.08 94.93 12:20:01 AM 1 3.75 0.00 0.18 0.00 0.07 96.00 12:21:01 AM all 4.26 0.00 0.18 0.00 0.07 95.49 12:21:01 AM 0 7.17 0.00 0.22 0.00 0.07 92.55 12:21:01 AM 1 1.37 0.00 0.13 0.00 0.07 98.43 12:22:01 AM all 5.78 0.00 1.45 0.00 0.04 92.73 12:22:01 AM 0 11.26 0.00 2.84 0.00 0.05 85.84 12:22:01 AM 1 0.75 0.00 0.17 0.00 0.03 99.05 12:22:01 AM CPU %user %nice %system %iowait %steal %idle 12:23:01 AM all 1.19 0.00 0.15 0.00 0.06 98.60 12:23:01 AM 0 1.77 0.00 0.22 0.00 0.07 97.94 12:23:01 AM 1 0.62 0.00 0.08 0.00 0.05 99.25 12:24:01 AM all 0.48 0.00 0.08 0.00 0.07 99.37 12:24:01 AM 0 0.38 0.00 0.13 0.00 0.08 99.40 12:24:01 AM 1 0.58 0.00 0.03 0.00 0.05 99.33 12:25:01 AM all 5.33 0.00 2.14 0.00 0.06 92.47 12:25:01 AM 0 7.58 0.00 4.11 0.00 0.05 88.25 12:25:01 AM 1 3.17 0.00 0.25 0.00 0.07 96.51 12:26:01 AM all 5.08 0.00 0.34 0.01 0.07 94.51 12:26:01 AM 0 8.24 0.00 0.49 0.00 0.07 91.20 12:26:01 AM 1 1.95 0.00 0.18 0.02 0.07 97.78 12:27:01 AM all 4.24 0.00 0.31 0.00 0.07 95.38 12:27:01 AM 0 5.98 0.00 0.40 0.00 0.07 93.56 12:27:01 AM 1 2.51 0.00 0.22 0.00 0.07 97.21 12:28:01 AM all 4.19 0.00 0.29 0.00 0.06 95.45 12:28:01 AM 0 4.64 0.00 0.33 0.00 0.07 94.96 12:28:01 AM 1 3.75 0.00 0.25 0.00 0.05 95.95 12:29:01 AM all 4.20 0.00 0.28 0.00 0.08 95.45 12:29:01 AM 0 3.26 0.00 0.25 0.00 0.07 96.42 12:29:01 AM 1 5.14 0.00 0.30 0.00 0.08 94.48 12:30:01 AM all 4.23 0.00 0.31 0.00 0.07 95.39 12:30:01 AM 0 3.80 0.00 0.28 0.00 0.07 95.85 12:30:01 AM 1 4.67 0.00 0.33 0.00 0.07 94.93 12:31:01 AM all 4.20 0.00 0.31 0.00 0.08 95.42 12:31:01 AM 0 3.41 0.00 0.30 0.00 0.08 96.21 12:31:01 AM 1 4.99 0.00 0.32 0.00 0.07 94.63 12:32:01 AM all 4.98 0.01 0.28 0.01 0.06 94.67 12:32:01 AM 0 4.10 0.02 0.23 0.02 0.07 95.57 12:32:01 AM 1 5.87 0.00 0.32 0.00 0.05 93.76 12:33:01 AM all 0.46 0.00 0.06 0.00 0.04 99.44 12:33:01 AM 0 0.32 0.00 0.07 0.00 0.03 99.58 12:33:01 AM 1 0.60 0.00 0.05 0.00 0.05 99.30 12:33:01 AM CPU %user %nice %system %iowait %steal %idle 12:34:01 AM all 0.23 0.00 0.08 0.00 0.04 99.64 12:34:01 AM 0 0.08 0.00 0.08 0.00 0.05 99.78 12:34:01 AM 1 0.38 0.00 0.08 0.00 0.03 99.50 12:35:01 AM all 0.49 0.00 0.07 0.00 0.03 99.41 12:35:01 AM 0 0.32 0.00 0.10 0.00 0.05 99.53 12:35:01 AM 1 0.67 0.00 0.03 0.00 0.02 99.28 12:36:01 AM all 0.32 0.00 0.06 0.00 0.03 99.59 12:36:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77 12:36:01 AM 1 0.52 0.00 0.03 0.00 0.03 99.42 12:37:01 AM all 0.47 0.00 0.08 0.00 0.04 99.42 12:37:01 AM 0 0.40 0.00 0.10 0.00 0.05 99.45 12:37:01 AM 1 0.53 0.00 0.05 0.00 0.03 99.38 12:38:01 AM all 0.34 0.00 0.05 0.00 0.05 99.56 12:38:01 AM 0 0.08 0.00 0.03 0.00 0.05 99.83 12:38:01 AM 1 0.60 0.00 0.07 0.00 0.05 99.28 12:39:01 AM all 2.59 0.00 0.20 0.00 0.03 97.18 12:39:01 AM 0 3.95 0.00 0.32 0.00 0.05 95.67 12:39:01 AM 1 1.25 0.00 0.08 0.00 0.02 98.65 12:40:01 AM all 5.93 0.00 2.81 0.00 0.07 91.19 12:40:01 AM 0 11.79 0.00 5.71 0.00 0.06 82.44 12:40:01 AM 1 0.62 0.00 0.18 0.00 0.08 99.12 12:41:01 AM all 1.87 0.00 1.10 0.00 0.04 96.99 12:41:01 AM 0 3.63 0.00 2.13 0.00 0.03 94.21 12:41:01 AM 1 0.17 0.00 0.10 0.00 0.05 99.68 12:42:01 AM all 0.34 0.00 0.08 0.00 0.04 99.54 12:42:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37 12:42:01 AM 1 0.13 0.00 0.10 0.00 0.05 99.72 12:43:01 AM all 3.60 0.00 1.41 0.00 0.05 94.94 12:43:01 AM 0 6.88 0.00 2.78 0.00 0.05 90.28 12:43:01 AM 1 0.50 0.00 0.12 0.00 0.05 99.33 12:44:01 AM all 5.05 0.00 0.23 0.00 0.06 94.67 12:44:01 AM 0 6.48 0.00 0.25 0.00 0.05 93.22 12:44:01 AM 1 3.63 0.00 0.20 0.00 0.07 96.10 12:44:01 AM CPU %user %nice %system %iowait %steal %idle 12:45:01 AM all 4.28 0.00 0.18 0.00 0.06 95.48 12:45:01 AM 0 5.74 0.00 0.20 0.00 0.07 93.99 12:45:01 AM 1 2.81 0.00 0.17 0.00 0.05 96.97 12:46:01 AM all 4.30 0.00 0.17 0.00 0.07 95.46 12:46:01 AM 0 6.81 0.00 0.23 0.00 0.07 92.89 12:46:01 AM 1 1.79 0.00 0.10 0.00 0.07 98.04 12:47:01 AM all 4.28 0.00 0.18 0.00 0.06 95.48 12:47:01 AM 0 5.84 0.00 0.18 0.00 0.07 93.91 12:47:01 AM 1 2.73 0.00 0.17 0.00 0.05 97.06 12:48:01 AM all 4.15 0.00 0.17 0.00 0.06 95.63 12:48:01 AM 0 3.86 0.00 0.15 0.00 0.05 95.94 12:48:01 AM 1 4.43 0.00 0.18 0.00 0.07 95.31 12:49:01 AM all 4.21 0.00 0.19 0.00 0.07 95.53 12:49:01 AM 0 4.70 0.00 0.20 0.00 0.07 95.03 12:49:01 AM 1 3.71 0.00 0.18 0.00 0.07 96.04 12:50:01 AM all 5.51 0.00 1.01 0.01 0.06 93.41 12:50:01 AM 0 10.64 0.00 1.97 0.00 0.05 87.34 12:50:01 AM 1 0.77 0.00 0.13 0.02 0.07 99.02 12:51:01 AM all 6.47 0.00 2.11 0.00 0.06 91.36 12:51:01 AM 0 1.57 0.00 0.13 0.00 0.05 98.25 12:51:01 AM 1 11.84 0.00 4.28 0.00 0.07 83.81 12:52:01 AM all 4.23 0.00 0.18 0.00 0.06 95.52 12:52:01 AM 0 6.21 0.00 0.20 0.00 0.07 93.52 12:52:01 AM 1 2.26 0.00 0.17 0.00 0.05 97.52 12:53:01 AM all 4.17 0.00 0.18 0.00 0.07 95.59 12:53:01 AM 0 6.08 0.00 0.20 0.00 0.07 93.65 12:53:01 AM 1 2.26 0.00 0.15 0.00 0.07 97.53 12:54:01 AM all 4.27 0.00 0.16 0.00 0.07 95.50 12:54:01 AM 0 6.03 0.00 0.17 0.00 0.08 93.72 12:54:01 AM 1 2.52 0.00 0.15 0.00 0.05 97.28 12:55:01 AM all 4.20 0.00 0.18 0.00 0.08 95.55 12:55:01 AM 0 7.01 0.00 0.23 0.00 0.08 92.67 12:55:01 AM 1 1.39 0.00 0.12 0.00 0.07 98.43 12:55:01 AM CPU %user %nice %system %iowait %steal %idle 12:56:01 AM all 4.06 0.00 0.17 0.00 0.07 95.70 12:56:01 AM 0 4.95 0.00 0.18 0.00 0.07 94.80 12:56:01 AM 1 3.18 0.00 0.15 0.00 0.07 96.60 12:57:01 AM all 4.28 0.00 0.17 0.00 0.07 95.48 12:57:01 AM 0 6.11 0.00 0.18 0.00 0.08 93.62 12:57:01 AM 1 2.46 0.00 0.15 0.00 0.05 97.34 12:58:01 AM all 6.27 0.00 1.45 0.00 0.05 92.23 12:58:01 AM 0 1.64 0.00 0.13 0.00 0.05 98.18 12:58:01 AM 1 11.32 0.00 2.89 0.00 0.05 85.73 12:59:01 AM all 5.84 0.16 2.18 0.02 0.06 91.74 12:59:01 AM 0 9.25 0.00 4.24 0.04 0.05 86.42 12:59:01 AM 1 2.67 0.30 0.27 0.00 0.07 96.69 01:00:01 AM all 4.23 0.00 0.33 0.00 0.07 95.38 01:00:01 AM 0 5.73 0.00 0.38 0.00 0.08 93.80 01:00:01 AM 1 2.72 0.00 0.27 0.00 0.05 96.96 01:01:01 AM all 4.09 0.00 0.30 0.00 0.06 95.55 01:01:01 AM 0 5.87 0.00 0.38 0.00 0.07 93.67 01:01:01 AM 1 2.31 0.00 0.22 0.00 0.05 97.42 01:02:01 AM all 4.20 0.00 0.33 0.00 0.07 95.39 01:02:01 AM 0 6.01 0.00 0.40 0.00 0.08 93.51 01:02:01 AM 1 2.41 0.00 0.27 0.00 0.05 97.28 01:03:01 AM all 4.27 0.00 0.31 0.00 0.07 95.36 01:03:01 AM 0 5.14 0.00 0.33 0.00 0.07 94.46 01:03:01 AM 1 3.39 0.00 0.28 0.00 0.07 96.25 01:04:02 AM all 4.17 0.00 0.32 0.00 0.06 95.46 01:04:02 AM 0 5.28 0.00 0.40 0.00 0.05 94.27 01:04:02 AM 1 3.06 0.00 0.23 0.00 0.07 96.64 01:05:01 AM all 6.92 0.00 0.40 0.00 0.08 92.61 01:05:01 AM 0 9.96 0.00 0.49 0.00 0.09 89.46 01:05:01 AM 1 3.88 0.00 0.31 0.00 0.07 95.75 01:06:01 AM all 0.63 0.00 0.09 0.00 0.05 99.22 01:06:01 AM 0 0.68 0.00 0.08 0.00 0.05 99.18 01:06:01 AM 1 0.58 0.00 0.10 0.00 0.05 99.27 01:06:01 AM CPU %user %nice %system %iowait %steal %idle 01:07:01 AM all 0.33 0.00 0.04 0.00 0.03 99.61 01:07:01 AM 0 0.57 0.00 0.05 0.00 0.03 99.35 01:07:01 AM 1 0.08 0.00 0.03 0.00 0.02 99.87 01:08:01 AM all 0.49 0.00 0.08 0.00 0.05 99.38 01:08:01 AM 0 0.88 0.00 0.08 0.00 0.05 98.98 01:08:01 AM 1 0.10 0.00 0.07 0.00 0.05 99.78 01:09:01 AM all 0.34 0.00 0.08 0.00 0.04 99.54 01:09:01 AM 0 0.57 0.00 0.03 0.00 0.03 99.37 01:09:01 AM 1 0.12 0.00 0.12 0.00 0.05 99.72 01:10:01 AM all 0.35 0.00 0.07 0.00 0.03 99.56 01:10:01 AM 0 0.58 0.00 0.05 0.00 0.02 99.35 01:10:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 01:11:01 AM all 0.50 0.00 0.08 0.00 0.04 99.38 01:11:01 AM 0 0.85 0.00 0.05 0.00 0.03 99.07 01:11:01 AM 1 0.15 0.00 0.10 0.00 0.05 99.70 01:12:01 AM all 0.32 0.00 0.05 0.00 0.03 99.60 01:12:01 AM 0 0.53 0.00 0.03 0.00 0.02 99.42 01:12:01 AM 1 0.10 0.00 0.07 0.00 0.05 99.78 01:13:01 AM all 5.44 0.00 2.27 0.00 0.05 92.24 01:13:01 AM 0 2.03 0.00 0.22 0.00 0.05 97.70 01:13:01 AM 1 9.07 0.00 4.46 0.00 0.05 86.42 01:14:01 AM all 5.43 0.00 1.61 0.00 0.05 92.91 01:14:01 AM 0 0.67 0.00 0.15 0.00 0.05 99.13 01:14:01 AM 1 10.59 0.00 3.18 0.00 0.05 86.17 01:15:01 AM all 0.34 0.00 0.07 0.00 0.03 99.56 01:15:01 AM 0 0.57 0.00 0.03 0.00 0.03 99.37 01:15:01 AM 1 0.12 0.00 0.10 0.00 0.03 99.75 01:16:01 AM all 0.80 0.00 0.09 0.01 0.04 99.06 01:16:01 AM 0 0.60 0.00 0.05 0.00 0.03 99.32 01:16:01 AM 1 0.99 0.00 0.13 0.02 0.05 98.81 01:17:01 AM all 5.96 0.00 1.38 0.00 0.06 92.60 01:17:01 AM 0 4.23 0.00 0.18 0.00 0.07 95.52 01:17:01 AM 1 7.81 0.00 2.64 0.00 0.05 89.49 01:17:01 AM CPU %user %nice %system %iowait %steal %idle 01:18:01 AM all 4.19 0.00 0.17 0.00 0.06 95.58 01:18:01 AM 0 5.48 0.00 0.15 0.00 0.07 94.30 01:18:01 AM 1 2.91 0.00 0.18 0.00 0.05 96.86 01:19:01 AM all 4.15 0.00 0.18 0.00 0.07 95.60 01:19:01 AM 0 4.89 0.00 0.22 0.00 0.07 94.83 01:19:01 AM 1 3.41 0.00 0.15 0.00 0.07 96.37 01:20:01 AM all 4.12 0.00 0.19 0.00 0.07 95.62 01:20:01 AM 0 6.47 0.00 0.23 0.00 0.08 93.21 01:20:01 AM 1 1.79 0.00 0.15 0.00 0.05 98.01 01:21:01 AM all 4.24 0.00 0.20 0.00 0.06 95.50 01:21:01 AM 0 5.93 0.00 0.20 0.00 0.07 93.81 01:21:01 AM 1 2.56 0.00 0.20 0.00 0.05 97.19 01:22:01 AM all 4.28 0.00 0.15 0.00 0.06 95.51 01:22:01 AM 0 5.86 0.00 0.18 0.00 0.07 93.89 01:22:01 AM 1 2.71 0.00 0.12 0.00 0.05 97.12 01:23:01 AM all 4.90 0.00 0.26 0.00 0.07 94.77 01:23:01 AM 0 6.58 0.00 0.32 0.00 0.05 93.04 01:23:01 AM 1 3.24 0.00 0.20 0.00 0.08 96.47 01:24:01 AM all 6.37 0.00 1.56 0.00 0.06 92.00 01:24:01 AM 0 12.73 0.00 3.06 0.00 0.07 84.13 01:24:01 AM 1 0.52 0.00 0.18 0.00 0.05 99.25 01:25:01 AM all 6.28 0.00 2.04 0.00 0.06 91.62 01:25:01 AM 0 10.93 0.00 4.07 0.00 0.05 84.94 01:25:01 AM 1 1.99 0.00 0.17 0.00 0.07 97.77 01:26:01 AM all 4.11 0.00 0.26 0.00 0.06 95.57 01:26:01 AM 0 6.42 0.00 0.37 0.00 0.07 93.15 01:26:01 AM 1 1.81 0.00 0.15 0.00 0.05 97.99 01:27:01 AM all 4.13 0.00 0.32 0.00 0.07 95.48 01:27:01 AM 0 6.20 0.00 0.44 0.00 0.08 93.28 01:27:01 AM 1 2.07 0.00 0.20 0.00 0.05 97.68 01:28:01 AM all 4.11 0.00 0.28 0.00 0.07 95.54 01:28:01 AM 0 4.70 0.00 0.33 0.00 0.07 94.90 01:28:01 AM 1 3.51 0.00 0.23 0.00 0.07 96.19 01:28:01 AM CPU %user %nice %system %iowait %steal %idle 01:29:01 AM all 4.22 0.00 0.29 0.00 0.06 95.43 01:29:01 AM 0 5.69 0.00 0.39 0.00 0.07 93.85 01:29:01 AM 1 2.74 0.00 0.20 0.00 0.05 97.01 01:30:01 AM all 4.25 0.00 0.34 0.00 0.07 95.34 01:30:01 AM 0 5.66 0.00 0.40 0.00 0.07 93.87 01:30:01 AM 1 2.84 0.00 0.28 0.00 0.07 96.81 01:31:01 AM all 6.20 0.00 0.37 0.00 0.06 93.38 01:31:01 AM 0 9.15 0.00 0.47 0.00 0.07 90.32 01:31:01 AM 1 3.25 0.00 0.27 0.00 0.05 96.44 01:32:01 AM all 1.94 0.00 0.13 0.00 0.05 97.88 01:32:01 AM 0 1.30 0.00 0.12 0.00 0.05 98.53 01:32:01 AM 1 2.58 0.00 0.15 0.00 0.05 97.22 01:33:01 AM all 0.33 0.00 0.05 0.00 0.03 99.59 01:33:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 01:33:01 AM 1 0.55 0.00 0.03 0.00 0.02 99.40 01:34:01 AM all 0.35 0.00 0.04 0.00 0.03 99.58 01:34:01 AM 0 0.22 0.00 0.05 0.00 0.02 99.72 01:34:01 AM 1 0.48 0.00 0.03 0.00 0.03 99.45 01:35:01 AM all 0.48 0.00 0.07 0.01 0.02 99.43 01:35:01 AM 0 0.30 0.00 0.08 0.02 0.03 99.57 01:35:01 AM 1 0.65 0.00 0.05 0.00 0.00 99.30 01:36:01 AM all 0.26 0.00 0.07 0.00 0.03 99.64 01:36:01 AM 0 0.13 0.00 0.10 0.00 0.05 99.72 01:36:01 AM 1 0.38 0.00 0.03 0.00 0.02 99.57 01:37:01 AM all 0.48 0.00 0.07 0.00 0.03 99.42 01:37:01 AM 0 0.38 0.00 0.07 0.00 0.02 99.53 01:37:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32 01:38:01 AM all 0.32 0.00 0.04 0.00 0.03 99.61 01:38:01 AM 0 0.08 0.00 0.05 0.00 0.03 99.83 01:38:01 AM 1 0.55 0.00 0.03 0.00 0.03 99.38 01:39:01 AM all 4.62 0.00 0.69 0.00 0.05 94.64 01:39:01 AM 0 8.99 0.00 1.27 0.00 0.07 89.67 01:39:01 AM 1 0.47 0.00 0.15 0.00 0.03 99.35 01:39:01 AM CPU %user %nice %system %iowait %steal %idle 01:40:01 AM all 5.35 0.00 3.32 0.00 0.06 91.28 01:40:01 AM 0 9.05 0.00 6.62 0.00 0.05 84.27 01:40:01 AM 1 1.90 0.00 0.26 0.00 0.07 97.77 01:41:01 AM all 0.33 0.00 0.08 0.00 0.03 99.56 01:41:01 AM 0 0.10 0.00 0.08 0.00 0.03 99.78 01:41:01 AM 1 0.55 0.00 0.08 0.00 0.03 99.33 01:42:01 AM all 0.33 0.00 0.05 0.00 0.03 99.59 01:42:01 AM 0 0.12 0.00 0.08 0.00 0.03 99.77 01:42:01 AM 1 0.55 0.00 0.02 0.00 0.02 99.42 01:43:01 AM all 0.50 0.00 0.08 0.00 0.05 99.37 01:43:01 AM 0 0.38 0.00 0.08 0.00 0.03 99.50 01:43:01 AM 1 0.62 0.00 0.07 0.00 0.07 99.25 01:44:01 AM all 0.23 0.00 0.09 0.00 0.03 99.64 01:44:01 AM 0 0.05 0.00 0.07 0.00 0.03 99.85 01:44:01 AM 1 0.42 0.00 0.12 0.00 0.03 99.43 01:45:01 AM all 0.44 0.00 0.08 0.00 0.03 99.45 01:45:01 AM 0 0.75 0.00 0.08 0.00 0.02 99.15 01:45:01 AM 1 0.13 0.00 0.07 0.00 0.05 99.75 01:46:01 AM all 0.34 0.00 0.07 0.00 0.03 99.56 01:46:01 AM 0 0.57 0.00 0.07 0.00 0.03 99.33 01:46:01 AM 1 0.12 0.00 0.07 0.00 0.03 99.78 01:47:01 AM all 0.46 0.00 0.09 0.00 0.03 99.42 01:47:01 AM 0 0.52 0.00 0.10 0.00 0.03 99.35 01:47:01 AM 1 0.40 0.00 0.08 0.00 0.03 99.48 01:48:01 AM all 0.16 0.00 0.08 0.00 0.03 99.72 01:48:01 AM 0 0.10 0.00 0.05 0.00 0.03 99.82 01:48:01 AM 1 0.22 0.00 0.12 0.00 0.03 99.63 01:49:01 AM all 0.47 0.00 0.07 0.00 0.03 99.44 01:49:01 AM 0 0.65 0.00 0.05 0.00 0.03 99.27 01:49:01 AM 1 0.28 0.00 0.08 0.00 0.02 99.62 01:50:01 AM all 0.33 0.00 0.06 0.00 0.03 99.58 01:50:01 AM 0 0.55 0.00 0.03 0.00 0.02 99.40 01:50:01 AM 1 0.12 0.00 0.08 0.00 0.03 99.77 01:50:01 AM CPU %user %nice %system %iowait %steal %idle 01:51:01 AM all 0.47 0.00 0.08 0.00 0.03 99.42 01:51:01 AM 0 0.60 0.00 0.07 0.00 0.03 99.30 01:51:01 AM 1 0.33 0.00 0.10 0.00 0.03 99.53 01:52:01 AM all 0.35 0.00 0.06 0.00 0.04 99.55 01:52:01 AM 0 0.60 0.00 0.05 0.00 0.03 99.32 01:52:01 AM 1 0.10 0.00 0.07 0.00 0.05 99.78 01:53:01 AM all 0.48 0.00 0.07 0.00 0.03 99.43 01:53:01 AM 0 0.62 0.00 0.07 0.00 0.03 99.28 01:53:01 AM 1 0.33 0.00 0.07 0.00 0.02 99.58 01:54:01 AM all 0.19 0.00 0.07 0.00 0.04 99.70 01:54:01 AM 0 0.28 0.00 0.07 0.00 0.05 99.60 01:54:01 AM 1 0.10 0.00 0.07 0.00 0.03 99.80 01:55:01 AM all 2.85 0.00 0.67 0.01 0.03 96.44 01:55:01 AM 0 0.58 0.00 0.08 0.00 0.03 99.30 01:55:01 AM 1 5.20 0.00 1.28 0.02 0.03 93.47 01:56:01 AM all 5.12 0.00 0.97 0.00 0.07 93.83 01:56:01 AM 0 2.24 0.00 0.18 0.00 0.05 97.53 01:56:01 AM 1 8.09 0.00 1.79 0.00 0.09 90.04 01:57:01 AM all 4.21 0.00 0.19 0.00 0.07 95.53 01:57:01 AM 0 3.83 0.00 0.17 0.00 0.07 95.94 01:57:01 AM 1 4.59 0.00 0.22 0.00 0.07 95.13 01:58:01 AM all 4.28 0.00 0.19 0.00 0.05 95.48 01:58:01 AM 0 1.89 0.00 0.15 0.00 0.05 97.91 01:58:01 AM 1 6.67 0.00 0.23 0.00 0.05 93.05 01:59:01 AM all 4.27 0.00 0.19 0.00 0.07 95.47 01:59:01 AM 0 3.81 0.00 0.18 0.00 0.05 95.95 01:59:01 AM 1 4.72 0.00 0.20 0.00 0.08 95.00 02:00:01 AM all 4.24 0.00 0.19 0.00 0.05 95.52 02:00:01 AM 0 4.33 0.00 0.18 0.00 0.05 95.43 02:00:01 AM 1 4.15 0.00 0.20 0.00 0.05 95.60 02:01:01 AM all 4.30 0.00 0.18 0.00 0.07 95.45 02:01:01 AM 0 6.32 0.00 0.22 0.00 0.08 93.38 02:01:01 AM 1 2.27 0.00 0.15 0.00 0.05 97.53 02:01:01 AM CPU %user %nice %system %iowait %steal %idle 02:02:01 AM all 5.30 0.00 0.34 0.00 0.06 94.30 02:02:01 AM 0 9.78 0.00 0.55 0.00 0.07 89.60 02:02:01 AM 1 1.05 0.00 0.15 0.00 0.05 98.75 02:03:01 AM all 2.84 0.00 1.26 0.00 0.04 95.86 02:03:01 AM 0 5.17 0.00 2.48 0.00 0.05 92.29 02:03:01 AM 1 0.60 0.00 0.10 0.00 0.03 99.26 02:04:01 AM all 0.18 0.00 0.08 0.00 0.03 99.72 02:04:01 AM 0 0.33 0.00 0.12 0.00 0.03 99.51 02:04:01 AM 1 0.03 0.00 0.03 0.00 0.02 99.92 02:05:01 AM all 0.45 0.00 0.07 0.01 0.03 99.44 02:05:01 AM 0 0.58 0.00 0.03 0.00 0.05 99.33 02:05:01 AM 1 0.32 0.00 0.10 0.02 0.02 99.55 02:06:01 AM all 0.32 0.00 0.06 0.00 0.03 99.60 02:06:01 AM 0 0.57 0.00 0.07 0.00 0.03 99.33 02:06:01 AM 1 0.07 0.00 0.05 0.00 0.02 99.87 02:07:01 AM all 0.43 0.00 0.05 0.00 0.03 99.48 02:07:01 AM 0 0.55 0.00 0.03 0.00 0.03 99.38 02:07:01 AM 1 0.32 0.00 0.07 0.00 0.03 99.58 02:08:01 AM all 0.32 0.00 0.06 0.00 0.04 99.58 02:08:01 AM 0 0.55 0.00 0.05 0.00 0.03 99.37 02:08:01 AM 1 0.08 0.00 0.07 0.00 0.05 99.80 02:09:01 AM all 0.45 0.00 0.06 0.00 0.03 99.47 02:09:01 AM 0 0.53 0.00 0.05 0.00 0.02 99.40 02:09:01 AM 1 0.37 0.00 0.07 0.00 0.03 99.53 02:10:01 AM all 0.27 0.00 0.06 0.02 0.03 99.63 02:10:01 AM 0 0.05 0.00 0.03 0.00 0.02 99.90 02:10:01 AM 1 0.48 0.00 0.08 0.03 0.03 99.36 02:11:02 AM all 0.41 0.00 0.09 0.00 0.03 99.47 02:11:02 AM 0 0.32 0.00 0.12 0.00 0.03 99.53 02:11:02 AM 1 0.50 0.00 0.07 0.00 0.03 99.40 02:12:01 AM all 0.36 0.00 0.07 0.00 0.03 99.55 02:12:01 AM 0 0.07 0.00 0.05 0.00 0.02 99.86 02:12:01 AM 1 0.65 0.00 0.08 0.00 0.03 99.24 02:12:01 AM CPU %user %nice %system %iowait %steal %idle 02:13:01 AM all 0.45 0.00 0.07 0.00 0.04 99.44 02:13:01 AM 0 0.38 0.00 0.08 0.00 0.05 99.48 02:13:01 AM 1 0.52 0.00 0.05 0.00 0.03 99.40 02:14:01 AM all 0.32 0.00 0.06 0.00 0.02 99.61 02:14:01 AM 0 0.08 0.00 0.07 0.00 0.02 99.83 02:14:01 AM 1 0.55 0.00 0.05 0.00 0.02 99.38 02:15:01 AM all 0.33 0.00 0.08 0.00 0.03 99.56 02:15:01 AM 0 0.50 0.00 0.10 0.00 0.03 99.36 02:15:01 AM 1 0.17 0.00 0.05 0.00 0.02 99.77 02:16:01 AM all 6.25 0.00 1.76 0.00 0.10 91.89 02:16:01 AM 0 11.22 0.00 3.43 0.00 0.12 85.23 02:16:01 AM 1 1.57 0.00 0.18 0.00 0.08 98.16 02:17:01 AM all 4.21 0.00 0.18 0.00 0.06 95.56 02:17:01 AM 0 4.08 0.00 0.18 0.00 0.05 95.68 02:17:01 AM 1 4.33 0.00 0.17 0.00 0.07 95.43 02:18:01 AM all 4.23 0.00 0.20 0.00 0.07 95.51 02:18:01 AM 0 2.87 0.00 0.15 0.00 0.05 96.92 02:18:01 AM 1 5.58 0.00 0.25 0.00 0.08 94.08 02:19:01 AM all 4.24 0.00 0.16 0.00 0.07 95.53 02:19:01 AM 0 6.28 0.00 0.18 0.00 0.07 93.47 02:19:01 AM 1 2.21 0.00 0.13 0.00 0.07 97.59 02:20:01 AM all 4.20 0.00 0.17 0.00 0.06 95.57 02:20:01 AM 0 7.15 0.00 0.22 0.00 0.07 92.56 02:20:01 AM 1 1.26 0.00 0.12 0.00 0.05 98.58 02:21:01 AM all 4.23 0.00 0.18 0.00 0.06 95.53 02:21:01 AM 0 7.09 0.00 0.20 0.00 0.07 92.65 02:21:01 AM 1 1.37 0.00 0.17 0.00 0.05 98.41 02:22:01 AM all 4.81 0.00 0.28 0.00 0.05 94.86 02:22:01 AM 0 6.89 0.00 0.38 0.00 0.05 92.68 02:22:01 AM 1 2.78 0.00 0.18 0.00 0.05 96.99 02:23:01 AM all 2.56 0.00 1.19 0.00 0.03 96.21 02:23:01 AM 0 4.60 0.00 2.35 0.00 0.03 93.01 02:23:01 AM 1 0.60 0.00 0.08 0.00 0.03 99.28 02:23:01 AM CPU %user %nice %system %iowait %steal %idle 02:24:01 AM all 0.33 0.00 0.06 0.00 0.03 99.57 02:24:01 AM 0 0.10 0.00 0.07 0.00 0.03 99.80 02:24:01 AM 1 0.57 0.00 0.05 0.00 0.03 99.35 02:25:01 AM all 0.46 0.00 0.08 0.02 0.03 99.42 02:25:01 AM 0 0.37 0.00 0.12 0.03 0.03 99.45 02:25:01 AM 1 0.55 0.00 0.03 0.00 0.02 99.40 02:26:01 AM all 0.36 0.00 0.06 0.00 0.04 99.54 02:26:01 AM 0 0.17 0.00 0.08 0.00 0.05 99.70 02:26:01 AM 1 0.55 0.00 0.03 0.00 0.03 99.38 02:27:01 AM all 0.36 0.00 0.09 0.00 0.03 99.52 02:27:01 AM 0 0.28 0.00 0.08 0.00 0.03 99.60 02:27:01 AM 1 0.43 0.00 0.10 0.00 0.03 99.43 02:28:01 AM all 0.25 0.00 0.06 0.00 0.02 99.67 02:28:01 AM 0 0.08 0.00 0.05 0.00 0.02 99.85 02:28:01 AM 1 0.42 0.00 0.07 0.00 0.02 99.50 02:29:01 AM all 0.45 0.00 0.08 0.00 0.03 99.44 02:29:01 AM 0 0.32 0.00 0.12 0.00 0.03 99.53 02:29:01 AM 1 0.58 0.00 0.05 0.00 0.02 99.35 02:30:01 AM all 0.34 0.00 0.06 0.00 0.03 99.57 02:30:01 AM 0 0.07 0.00 0.05 0.00 0.02 99.87 02:30:01 AM 1 0.62 0.00 0.07 0.00 0.03 99.28 02:31:01 AM all 0.48 0.00 0.08 0.00 0.03 99.42 02:31:01 AM 0 0.37 0.00 0.10 0.00 0.02 99.52 02:31:01 AM 1 0.58 0.00 0.07 0.00 0.03 99.32 02:32:01 AM all 0.35 0.00 0.06 0.00 0.03 99.57 02:32:01 AM 0 0.05 0.00 0.03 0.00 0.02 99.90 02:32:01 AM 1 0.65 0.00 0.08 0.00 0.03 99.23 02:33:01 AM all 0.32 0.00 0.12 0.00 0.03 99.53 02:33:01 AM 0 0.38 0.00 0.10 0.00 0.02 99.50 02:33:01 AM 1 0.25 0.00 0.13 0.00 0.05 99.57 02:34:01 AM all 0.33 0.00 0.06 0.00 0.02 99.59 02:34:01 AM 0 0.10 0.00 0.07 0.00 0.02 99.82 02:34:01 AM 1 0.57 0.00 0.05 0.00 0.02 99.37 02:34:01 AM CPU %user %nice %system %iowait %steal %idle 02:35:01 AM all 0.70 0.00 0.05 0.00 0.03 99.23 02:35:01 AM 0 0.82 0.00 0.07 0.00 0.03 99.08 02:35:01 AM 1 0.57 0.00 0.03 0.00 0.02 99.38 02:36:01 AM all 5.41 0.00 1.44 0.00 0.06 93.09 02:36:01 AM 0 7.89 0.00 2.78 0.00 0.05 89.28 02:36:01 AM 1 3.11 0.00 0.18 0.00 0.07 96.64 02:37:01 AM all 4.39 0.00 0.18 0.00 0.08 95.35 02:37:01 AM 0 2.54 0.00 0.17 0.00 0.05 97.24 02:37:01 AM 1 6.25 0.00 0.18 0.00 0.12 93.45 02:38:01 AM all 4.73 0.00 0.21 0.00 0.16 94.91 02:38:01 AM 0 4.15 0.00 0.20 0.00 0.13 95.52 02:38:01 AM 1 5.30 0.00 0.22 0.00 0.18 94.29 02:39:01 AM all 4.30 0.00 0.20 0.00 0.07 95.43 02:39:01 AM 0 1.34 0.00 0.17 0.00 0.05 98.45 02:39:01 AM 1 7.27 0.00 0.23 0.00 0.08 92.41 02:40:01 AM all 4.30 0.00 0.19 0.01 0.04 95.46 02:40:01 AM 0 3.21 0.00 0.17 0.00 0.03 96.59 02:40:01 AM 1 5.39 0.00 0.22 0.02 0.05 94.33 02:41:01 AM all 4.20 0.00 0.20 0.00 0.05 95.55 02:41:01 AM 0 2.91 0.00 0.15 0.00 0.05 96.89 02:41:01 AM 1 5.49 0.00 0.25 0.00 0.05 94.20 02:42:01 AM all 4.98 0.00 0.25 0.00 0.04 94.73 02:42:01 AM 0 8.59 0.00 0.38 0.00 0.05 90.98 02:42:01 AM 1 1.47 0.00 0.13 0.00 0.03 98.36 02:43:01 AM all 2.62 0.00 1.17 0.00 0.04 96.16 02:43:01 AM 0 2.49 0.00 2.15 0.00 0.05 95.31 02:43:01 AM 1 2.75 0.00 0.20 0.00 0.03 97.02 02:44:01 AM all 0.33 0.00 0.11 0.00 0.07 99.50 02:44:01 AM 0 0.22 0.00 0.10 0.00 0.08 99.60 02:44:01 AM 1 0.43 0.00 0.12 0.00 0.05 99.40 02:45:01 AM all 0.47 0.00 0.16 0.00 0.10 99.27 02:45:01 AM 0 0.43 0.00 0.10 0.00 0.08 99.38 02:45:01 AM 1 0.50 0.00 0.22 0.00 0.12 99.17 02:45:01 AM CPU %user %nice %system %iowait %steal %idle 02:46:01 AM all 0.33 0.00 0.08 0.00 0.02 99.57 02:46:01 AM 0 0.15 0.00 0.08 0.00 0.02 99.75 02:46:01 AM 1 0.52 0.00 0.07 0.00 0.02 99.40 02:47:01 AM all 0.49 0.00 0.07 0.00 0.03 99.41 02:47:01 AM 0 0.52 0.00 0.10 0.00 0.02 99.37 02:47:01 AM 1 0.47 0.00 0.03 0.00 0.05 99.45 02:48:01 AM all 0.33 0.00 0.09 0.00 0.06 99.52 02:48:01 AM 0 0.35 0.00 0.08 0.00 0.07 99.50 02:48:01 AM 1 0.30 0.00 0.10 0.00 0.05 99.55 02:49:01 AM all 0.47 0.00 0.08 0.00 0.02 99.44 02:49:01 AM 0 0.62 0.00 0.08 0.00 0.02 99.28 02:49:01 AM 1 0.32 0.00 0.07 0.00 0.02 99.60 02:50:01 AM all 0.28 0.00 0.11 0.03 0.05 99.53 02:50:01 AM 0 0.37 0.00 0.08 0.07 0.05 99.43 02:50:01 AM 1 0.18 0.00 0.13 0.00 0.05 99.63 02:51:01 AM all 0.48 0.00 0.10 0.00 0.12 99.30 02:51:01 AM 0 0.73 0.00 0.12 0.00 0.15 99.00 02:51:01 AM 1 0.23 0.00 0.08 0.00 0.08 99.60 02:52:01 AM all 0.31 0.00 0.08 0.00 0.05 99.56 02:52:01 AM 0 0.48 0.00 0.08 0.00 0.03 99.40 02:52:01 AM 1 0.13 0.00 0.08 0.00 0.07 99.72 02:53:01 AM all 0.44 0.00 0.11 0.00 0.09 99.36 02:53:01 AM 0 0.77 0.00 0.13 0.00 0.10 99.00 02:53:01 AM 1 0.12 0.00 0.08 0.00 0.08 99.72 02:54:01 AM all 0.25 0.00 0.09 0.00 0.04 99.62 02:54:01 AM 0 0.37 0.00 0.10 0.00 0.03 99.50 02:54:01 AM 1 0.13 0.00 0.08 0.00 0.05 99.73 02:55:01 AM all 1.09 2.12 0.26 0.53 0.03 95.96 02:55:01 AM 0 1.69 3.87 0.30 0.57 0.03 93.54 02:55:01 AM 1 0.50 0.37 0.22 0.50 0.02 98.39 02:56:01 AM all 7.81 0.00 2.74 0.00 0.13 89.32 02:56:01 AM 0 9.55 0.00 5.04 0.00 0.11 85.30 02:56:01 AM 1 6.11 0.00 0.48 0.00 0.15 93.25 02:56:01 AM CPU %user %nice %system %iowait %steal %idle 02:57:01 AM all 4.81 0.00 0.40 0.00 0.16 94.62 02:57:01 AM 0 6.72 0.00 0.52 0.00 0.17 92.60 02:57:01 AM 1 2.91 0.00 0.28 0.00 0.15 96.65 02:58:01 AM all 4.61 0.00 0.33 0.00 0.05 95.01 02:58:01 AM 0 6.45 0.00 0.37 0.00 0.05 93.13 02:58:01 AM 1 2.78 0.00 0.28 0.00 0.05 96.89 02:59:01 AM all 4.81 0.00 0.38 0.00 0.27 94.55 02:59:01 AM 0 5.20 0.00 0.40 0.00 0.28 94.11 02:59:01 AM 1 4.42 0.00 0.35 0.00 0.25 94.98 03:00:01 AM all 5.25 0.00 0.44 0.04 0.64 93.62 03:00:01 AM 0 6.89 0.00 0.52 0.08 0.70 91.80 03:00:01 AM 1 3.61 0.00 0.37 0.00 0.58 95.44 03:01:01 AM all 5.19 0.00 0.50 0.01 0.69 93.62 03:01:01 AM 0 7.46 0.00 0.72 0.02 0.75 91.06 03:01:01 AM 1 2.92 0.00 0.28 0.00 0.62 96.18 03:02:01 AM all 6.58 0.00 0.41 0.00 0.66 92.35 03:02:01 AM 0 7.75 0.00 0.43 0.00 0.77 91.04 03:02:01 AM 1 5.41 0.00 0.38 0.00 0.55 93.65 03:03:01 AM all 4.48 0.00 0.33 0.00 0.59 94.60 03:03:01 AM 0 5.73 0.00 0.38 0.00 0.77 93.12 03:03:01 AM 1 3.24 0.00 0.27 0.00 0.42 96.08 03:04:01 AM all 0.40 0.00 0.12 0.00 0.29 99.19 03:04:01 AM 0 0.18 0.00 0.12 0.00 0.32 99.38 03:04:01 AM 1 0.62 0.00 0.12 0.00 0.27 99.00 03:05:01 AM all 0.41 0.00 0.10 0.00 0.21 99.28 03:05:01 AM 0 0.60 0.00 0.08 0.00 0.30 99.02 03:05:01 AM 1 0.22 0.00 0.12 0.00 0.12 99.55 03:06:01 AM all 0.57 0.00 0.11 0.00 0.19 99.13 03:06:01 AM 0 0.75 0.00 0.07 0.00 0.15 99.03 03:06:01 AM 1 0.38 0.00 0.15 0.00 0.23 99.23 03:07:01 AM all 0.38 0.00 0.10 0.00 0.12 99.40 03:07:01 AM 0 0.52 0.00 0.05 0.00 0.10 99.33 03:07:01 AM 1 0.25 0.00 0.15 0.00 0.13 99.47 03:07:01 AM CPU %user %nice %system %iowait %steal %idle 03:08:01 AM all 0.65 0.00 0.10 0.00 0.26 98.99 03:08:01 AM 0 0.72 0.00 0.05 0.00 0.28 98.95 03:08:01 AM 1 0.58 0.00 0.15 0.00 0.23 99.03 03:09:01 AM all 0.45 0.00 0.14 0.00 0.23 99.17 03:09:01 AM 0 0.23 0.00 0.15 0.00 0.32 99.30 03:09:01 AM 1 0.67 0.00 0.13 0.00 0.15 99.05 03:10:01 AM all 6.08 0.00 0.48 0.01 0.40 93.04 03:10:01 AM 0 11.21 0.00 0.67 0.00 0.46 87.67 03:10:01 AM 1 1.18 0.00 0.30 0.02 0.35 98.15 03:11:02 AM all 8.32 0.00 4.25 0.00 0.39 87.04 03:11:02 AM 0 9.48 0.00 7.92 0.00 0.48 82.12 03:11:02 AM 1 7.18 0.00 0.66 0.00 0.31 91.85 03:12:01 AM all 1.08 0.00 0.13 0.00 0.08 98.71 03:12:01 AM 0 1.92 0.00 0.19 0.00 0.09 97.80 03:12:01 AM 1 0.25 0.00 0.07 0.00 0.07 99.61 03:13:01 AM all 0.42 0.00 0.10 0.00 0.22 99.27 03:13:01 AM 0 0.62 0.00 0.08 0.00 0.27 99.03 03:13:01 AM 1 0.22 0.00 0.12 0.00 0.17 99.50 03:14:01 AM all 6.27 0.00 1.62 0.00 0.21 91.90 03:14:01 AM 0 7.82 0.00 1.94 0.00 0.21 90.03 03:14:01 AM 1 4.75 0.00 1.31 0.00 0.21 93.74 03:15:01 AM all 5.03 0.00 0.23 0.01 0.14 94.59 03:15:01 AM 0 4.26 0.00 0.23 0.02 0.10 95.39 03:15:01 AM 1 5.80 0.00 0.23 0.00 0.18 93.78 03:16:01 AM all 5.06 0.00 0.28 0.00 0.44 94.22 03:16:01 AM 0 6.30 0.00 0.27 0.00 0.47 92.97 03:16:01 AM 1 3.83 0.00 0.28 0.00 0.42 95.47 03:17:01 AM all 5.21 0.00 0.24 0.00 0.78 93.76 03:17:01 AM 0 4.91 0.00 0.23 0.00 0.85 94.00 03:17:01 AM 1 5.51 0.00 0.25 0.00 0.72 93.52 03:18:01 AM all 5.13 0.00 0.27 0.00 0.64 93.96 03:18:01 AM 0 5.98 0.00 0.27 0.00 0.70 93.06 03:18:01 AM 1 4.28 0.00 0.27 0.00 0.58 94.87 03:18:01 AM CPU %user %nice %system %iowait %steal %idle 03:19:01 AM all 5.29 0.00 0.29 0.00 0.62 93.80 03:19:01 AM 0 5.80 0.00 0.30 0.00 0.65 93.25 03:19:01 AM 1 4.77 0.00 0.28 0.00 0.59 94.36 03:20:01 AM all 5.35 0.00 0.28 0.00 0.54 93.84 03:20:01 AM 0 4.69 0.00 0.25 0.00 0.58 94.47 03:20:01 AM 1 6.01 0.00 0.30 0.00 0.49 93.20 03:21:01 AM all 9.48 0.00 2.22 0.04 0.55 87.72 03:21:01 AM 0 8.65 0.00 0.60 0.07 0.58 90.11 03:21:01 AM 1 10.32 0.00 3.84 0.00 0.53 85.32 03:22:01 AM all 9.61 0.00 2.08 0.00 0.71 87.59 03:22:01 AM 0 3.26 0.00 0.71 0.00 0.59 95.45 03:22:01 AM 1 16.40 0.00 3.55 0.00 0.84 79.20 03:23:01 AM all 5.23 0.00 0.28 0.00 0.62 93.86 03:23:01 AM 0 5.09 0.00 0.28 0.00 0.60 94.02 03:23:01 AM 1 5.38 0.00 0.28 0.00 0.64 93.70 03:24:01 AM all 5.58 0.00 0.33 0.00 0.95 93.13 03:24:01 AM 0 5.60 0.00 0.28 0.00 0.97 93.15 03:24:01 AM 1 5.56 0.00 0.38 0.00 0.93 93.12 03:25:01 AM all 5.38 0.00 0.27 0.01 0.38 93.97 03:25:01 AM 0 6.40 0.00 0.28 0.02 0.42 92.88 03:25:01 AM 1 4.37 0.00 0.25 0.00 0.33 95.05 03:26:01 AM all 4.96 0.00 0.25 0.00 0.43 94.36 03:26:01 AM 0 3.93 0.00 0.22 0.00 0.33 95.51 03:26:01 AM 1 5.98 0.00 0.28 0.00 0.52 93.21 03:27:01 AM all 4.99 0.00 0.23 0.00 0.27 94.50 03:27:01 AM 0 5.30 0.00 0.23 0.00 0.30 94.16 03:27:01 AM 1 4.68 0.00 0.23 0.00 0.23 94.85 03:28:01 AM all 5.43 0.00 0.26 0.00 0.24 94.06 03:28:01 AM 0 6.99 0.00 0.29 0.00 0.20 92.51 03:28:01 AM 1 3.89 0.00 0.23 0.00 0.29 95.59 03:29:01 AM all 8.16 0.00 1.90 0.00 0.30 89.65 03:29:01 AM 0 7.27 0.00 0.83 0.00 0.33 91.57 03:29:01 AM 1 9.06 0.00 2.98 0.00 0.26 87.69 03:29:01 AM CPU %user %nice %system %iowait %steal %idle 03:30:01 AM all 7.19 0.00 2.66 0.01 0.39 89.75 03:30:01 AM 0 6.34 0.00 0.42 0.00 0.41 92.83 03:30:01 AM 1 8.05 0.00 4.94 0.02 0.38 86.61 03:31:01 AM all 5.29 0.00 0.37 0.00 0.42 93.93 03:31:01 AM 0 8.12 0.00 0.47 0.00 0.44 90.97 03:31:01 AM 1 2.46 0.00 0.27 0.00 0.40 96.87 03:32:01 AM all 5.21 0.00 0.42 0.00 0.53 93.85 03:32:01 AM 0 5.60 0.00 0.40 0.00 0.45 93.54 03:32:01 AM 1 4.81 0.00 0.43 0.00 0.60 94.15 03:33:01 AM all 5.00 0.00 0.37 0.00 0.17 94.46 03:33:01 AM 0 4.42 0.00 0.28 0.00 0.17 95.13 03:33:01 AM 1 5.59 0.00 0.45 0.00 0.17 93.79 03:34:01 AM all 4.95 0.00 0.41 0.00 0.33 94.31 03:34:01 AM 0 6.30 0.00 0.47 0.00 0.33 92.90 03:34:01 AM 1 3.59 0.00 0.35 0.00 0.33 95.72 03:35:01 AM all 5.00 0.00 0.38 0.01 0.39 94.21 03:35:01 AM 0 3.75 0.00 0.33 0.00 0.38 95.54 03:35:01 AM 1 6.26 0.00 0.44 0.02 0.40 92.88 03:36:01 AM all 8.21 0.00 0.48 0.00 0.74 90.57 03:36:01 AM 0 10.37 0.00 0.52 0.00 0.75 88.36 03:36:01 AM 1 6.06 0.00 0.45 0.00 0.72 92.77 03:37:01 AM all 0.80 0.00 0.11 0.00 0.24 98.85 03:37:01 AM 0 0.65 0.00 0.08 0.00 0.23 99.03 03:37:01 AM 1 0.95 0.00 0.13 0.00 0.25 98.67 03:38:01 AM all 0.36 0.00 0.08 0.00 0.18 99.37 03:38:01 AM 0 0.22 0.00 0.10 0.00 0.15 99.53 03:38:01 AM 1 0.50 0.00 0.07 0.00 0.22 99.22 03:39:01 AM all 0.65 0.00 0.11 0.00 0.20 99.04 03:39:01 AM 0 0.72 0.00 0.08 0.00 0.23 98.97 03:39:01 AM 1 0.58 0.00 0.13 0.00 0.17 99.12 03:40:01 AM all 0.40 0.00 0.09 0.00 0.18 99.33 03:40:01 AM 0 0.23 0.00 0.12 0.00 0.18 99.47 03:40:01 AM 1 0.57 0.00 0.07 0.00 0.17 99.20 03:40:01 AM CPU %user %nice %system %iowait %steal %idle 03:41:01 AM all 0.42 0.00 0.13 0.00 0.31 99.14 03:41:01 AM 0 0.47 0.00 0.13 0.00 0.23 99.17 03:41:01 AM 1 0.37 0.00 0.13 0.00 0.38 99.12 03:42:01 AM all 0.65 0.00 0.09 0.00 0.22 99.04 03:42:01 AM 0 0.65 0.00 0.05 0.00 0.23 99.07 03:42:01 AM 1 0.65 0.00 0.13 0.00 0.20 99.02 03:43:01 AM all 0.39 0.00 0.08 0.00 0.14 99.38 03:43:01 AM 0 0.60 0.00 0.05 0.00 0.10 99.25 03:43:01 AM 1 0.18 0.00 0.12 0.00 0.18 99.52 03:44:01 AM all 9.24 0.00 4.46 0.00 0.93 85.37 03:44:01 AM 0 8.58 0.00 5.66 0.00 1.05 84.71 03:44:01 AM 1 9.89 0.00 3.26 0.00 0.81 86.04 03:45:01 AM all 7.77 0.00 2.03 0.00 0.61 89.59 03:45:01 AM 0 5.92 0.00 0.39 0.00 0.41 93.27 03:45:01 AM 1 9.66 0.00 3.72 0.00 0.81 85.81 03:46:01 AM all 0.44 0.00 0.08 0.00 0.21 99.27 03:46:01 AM 0 0.58 0.00 0.07 0.00 0.25 99.10 03:46:01 AM 1 0.30 0.00 0.08 0.00 0.17 99.45 03:47:01 AM all 1.63 0.00 0.22 0.00 0.55 97.61 03:47:01 AM 0 2.85 0.00 0.27 0.00 0.46 96.42 03:47:01 AM 1 0.43 0.00 0.17 0.00 0.63 98.77 03:48:01 AM all 8.64 0.00 2.85 0.00 0.47 88.04 03:48:01 AM 0 15.63 0.00 5.69 0.00 0.63 78.06 03:48:01 AM 1 2.25 0.00 0.25 0.00 0.34 97.16 03:49:01 AM all 8.93 0.00 2.34 0.00 0.45 88.28 03:49:01 AM 0 6.53 0.00 3.61 0.00 0.40 89.46 03:49:01 AM 1 11.35 0.00 1.05 0.00 0.51 87.08 03:50:01 AM all 9.07 0.00 3.06 0.00 0.56 87.31 03:50:01 AM 0 6.32 0.00 1.80 0.00 0.45 91.44 03:50:01 AM 1 11.93 0.00 4.37 0.00 0.68 83.02 03:51:01 AM all 3.31 0.00 0.80 0.00 0.42 95.47 03:51:01 AM 0 4.70 0.00 0.79 0.00 0.30 94.20 03:51:01 AM 1 1.93 0.00 0.81 0.00 0.54 96.72 03:51:01 AM CPU %user %nice %system %iowait %steal %idle 03:52:01 AM all 0.52 0.00 0.13 0.00 0.29 99.06 03:52:01 AM 0 0.75 0.00 0.12 0.00 0.27 98.87 03:52:01 AM 1 0.28 0.00 0.15 0.00 0.32 99.25 03:53:01 AM all 6.52 0.00 2.04 0.00 0.39 91.06 03:53:01 AM 0 9.54 0.00 3.78 0.00 0.40 86.28 03:53:01 AM 1 3.61 0.00 0.37 0.00 0.37 95.64 03:54:01 AM all 6.72 0.00 1.05 0.00 0.52 91.71 03:54:01 AM 0 7.13 0.00 1.63 0.00 0.54 90.70 03:54:01 AM 1 6.30 0.00 0.46 0.00 0.51 92.73 03:55:01 AM all 5.26 0.00 0.42 0.01 0.64 93.67 03:55:01 AM 0 5.01 0.00 0.42 0.02 0.53 94.02 03:55:01 AM 1 5.51 0.00 0.42 0.00 0.75 93.32 03:56:01 AM all 5.62 0.00 0.44 0.00 0.98 92.96 03:56:01 AM 0 5.87 0.00 0.43 0.00 1.08 92.62 03:56:01 AM 1 5.38 0.00 0.45 0.00 0.87 93.30 03:57:01 AM all 5.31 0.00 0.50 0.00 0.88 93.32 03:57:01 AM 0 4.93 0.00 0.55 0.00 0.95 93.57 03:57:01 AM 1 5.68 0.00 0.45 0.00 0.80 93.06 03:58:01 AM all 5.02 0.00 0.34 0.00 0.60 94.03 03:58:01 AM 0 4.88 0.00 0.33 0.00 0.58 94.21 03:58:01 AM 1 5.17 0.00 0.35 0.00 0.62 93.86 03:59:01 AM all 5.48 0.00 0.38 0.00 0.94 93.20 03:59:01 AM 0 5.40 0.00 0.37 0.00 0.92 93.32 03:59:01 AM 1 5.56 0.00 0.40 0.00 0.97 93.07 04:00:01 AM all 7.57 0.00 0.46 0.01 0.77 91.20 04:00:01 AM 0 7.09 0.00 0.48 0.00 0.82 91.61 04:00:01 AM 1 8.04 0.00 0.43 0.02 0.72 90.79 04:01:01 AM all 0.71 0.00 0.13 0.01 0.10 99.06 04:01:01 AM 0 0.43 0.00 0.13 0.02 0.12 99.30 04:01:01 AM 1 0.99 0.00 0.12 0.00 0.08 98.81 04:02:01 AM all 0.39 0.00 0.13 0.00 0.13 99.35 04:02:01 AM 0 0.56 0.00 0.12 0.00 0.19 99.13 04:02:01 AM 1 0.22 0.00 0.14 0.00 0.07 99.58 04:02:01 AM CPU %user %nice %system %iowait %steal %idle 04:03:01 AM all 0.63 0.00 0.12 0.00 0.22 99.04 04:03:01 AM 0 0.48 0.00 0.12 0.00 0.23 99.17 04:03:01 AM 1 0.77 0.00 0.12 0.00 0.20 98.92 04:04:01 AM all 0.35 0.00 0.10 0.00 0.07 99.48 04:04:01 AM 0 0.18 0.00 0.07 0.00 0.07 99.68 04:04:01 AM 1 0.52 0.00 0.13 0.00 0.07 99.28 04:05:01 AM all 0.67 0.00 0.13 0.00 0.30 98.90 04:05:01 AM 0 0.40 0.00 0.12 0.00 0.37 99.12 04:05:01 AM 1 0.93 0.00 0.15 0.00 0.23 98.68 04:06:01 AM all 0.39 0.00 0.10 0.00 0.23 99.28 04:06:01 AM 0 0.62 0.00 0.08 0.00 0.20 99.10 04:06:01 AM 1 0.17 0.00 0.12 0.00 0.25 99.47 04:07:01 AM all 1.55 0.00 0.15 0.00 0.48 97.82 04:07:01 AM 0 1.83 0.00 0.13 0.00 0.50 97.53 04:07:01 AM 1 1.27 0.00 0.17 0.00 0.47 98.10 04:08:01 AM all 8.45 0.00 4.46 0.00 0.50 86.60 04:08:01 AM 0 7.77 0.00 4.17 0.00 0.43 87.63 04:08:01 AM 1 9.13 0.00 4.75 0.00 0.56 85.56 04:09:01 AM all 5.71 0.00 2.07 0.00 0.29 91.93 04:09:01 AM 0 2.55 0.00 0.22 0.00 0.18 97.05 04:09:01 AM 1 8.97 0.00 3.97 0.00 0.40 86.66 04:10:01 AM all 0.38 0.00 0.08 0.01 0.23 99.31 04:10:01 AM 0 0.43 0.00 0.08 0.00 0.18 99.30 04:10:01 AM 1 0.33 0.00 0.07 0.02 0.27 99.32 04:11:01 AM all 3.06 0.00 0.29 0.00 0.33 96.32 04:11:01 AM 0 4.64 0.00 0.38 0.00 0.43 94.55 04:11:01 AM 1 1.51 0.00 0.20 0.00 0.24 98.05 04:12:01 AM all 9.13 0.00 3.78 0.00 0.54 86.54 04:12:01 AM 0 10.71 0.00 2.56 0.00 0.60 86.12 04:12:01 AM 1 7.58 0.00 4.98 0.00 0.49 86.96 04:13:01 AM all 8.82 0.00 1.95 0.00 0.47 88.76 04:13:01 AM 0 3.98 0.00 0.39 0.00 0.36 95.27 04:13:01 AM 1 14.02 0.00 3.62 0.00 0.59 81.77 04:13:01 AM CPU %user %nice %system %iowait %steal %idle 04:14:01 AM all 8.83 0.00 3.64 0.00 0.36 87.17 04:14:01 AM 0 6.28 0.00 0.66 0.00 0.33 92.74 04:14:01 AM 1 11.47 0.00 6.72 0.00 0.39 81.41 04:15:01 AM all 1.73 0.00 0.20 0.00 0.29 97.78 04:15:01 AM 0 1.15 0.00 0.18 0.00 0.23 98.43 04:15:01 AM 1 2.31 0.00 0.22 0.00 0.35 97.12 04:16:01 AM all 0.49 0.00 0.13 0.00 0.18 99.20 04:16:01 AM 0 0.72 0.00 0.13 0.00 0.18 98.97 04:16:01 AM 1 0.27 0.00 0.13 0.00 0.17 99.43 04:17:01 AM all 8.44 0.00 3.16 0.00 0.31 88.08 04:17:01 AM 0 16.01 0.00 6.30 0.00 0.35 77.34 04:17:01 AM 1 1.49 0.00 0.28 0.00 0.28 97.95 04:18:01 AM all 6.31 0.00 0.45 0.00 0.38 92.86 04:18:01 AM 0 5.53 0.00 0.45 0.00 0.35 93.67 04:18:01 AM 1 7.09 0.00 0.45 0.00 0.40 92.05 04:19:01 AM all 5.37 0.00 0.39 0.00 0.58 93.66 04:19:01 AM 0 4.04 0.00 0.37 0.00 0.60 94.99 04:19:01 AM 1 6.69 0.00 0.42 0.00 0.55 92.34 04:20:01 AM all 5.62 0.00 0.44 0.01 0.61 93.32 04:20:01 AM 0 3.08 0.00 0.33 0.02 0.55 96.02 04:20:01 AM 1 8.16 0.00 0.55 0.00 0.67 90.61 04:21:01 AM all 5.58 0.33 0.58 0.07 0.83 92.62 04:21:01 AM 0 4.43 0.17 0.50 0.13 0.87 93.90 04:21:01 AM 1 6.74 0.48 0.65 0.00 0.79 91.34 04:22:01 AM all 5.45 0.00 0.43 0.00 0.40 93.72 04:22:01 AM 0 6.85 0.00 0.45 0.00 0.40 92.30 04:22:01 AM 1 4.05 0.00 0.40 0.00 0.40 95.15 04:23:01 AM all 4.90 0.00 0.35 0.00 0.09 94.65 04:23:01 AM 0 2.86 0.00 0.32 0.00 0.08 96.73 04:23:01 AM 1 6.94 0.00 0.39 0.00 0.10 92.57 04:24:01 AM all 6.31 0.00 0.34 0.00 0.09 93.26 04:24:01 AM 0 1.90 0.00 0.23 0.00 0.07 97.79 04:24:01 AM 1 10.75 0.00 0.44 0.00 0.12 88.70 04:24:01 AM CPU %user %nice %system %iowait %steal %idle 04:25:01 AM all 0.59 0.00 0.09 0.07 0.04 99.21 04:25:01 AM 0 0.43 0.00 0.10 0.03 0.05 99.38 04:25:01 AM 1 0.75 0.00 0.08 0.10 0.03 99.03 04:26:01 AM all 0.38 0.00 0.12 0.00 0.18 99.32 04:26:01 AM 0 0.37 0.00 0.10 0.00 0.17 99.37 04:26:01 AM 1 0.40 0.00 0.13 0.00 0.20 99.27 04:27:01 AM all 0.55 0.00 0.09 0.00 0.03 99.32 04:27:01 AM 0 0.47 0.00 0.10 0.00 0.03 99.40 04:27:01 AM 1 0.64 0.00 0.08 0.00 0.03 99.25 04:28:01 AM all 0.35 0.00 0.11 0.00 0.03 99.51 04:28:01 AM 0 0.40 0.00 0.13 0.00 0.03 99.43 04:28:01 AM 1 0.30 0.00 0.08 0.00 0.03 99.58 04:29:01 AM all 0.58 0.00 0.13 0.00 0.13 99.17 04:29:01 AM 0 0.35 0.00 0.13 0.00 0.15 99.37 04:29:01 AM 1 0.82 0.00 0.12 0.00 0.10 98.97 04:30:01 AM all 0.38 0.00 0.10 0.04 0.08 99.40 04:30:01 AM 0 0.48 0.00 0.10 0.00 0.08 99.33 04:30:01 AM 1 0.28 0.00 0.10 0.08 0.07 99.47 04:31:01 AM all 2.85 0.00 0.22 0.03 0.08 96.81 04:31:01 AM 0 4.30 0.00 0.29 0.07 0.07 95.27 04:31:01 AM 1 1.42 0.00 0.15 0.00 0.10 98.33 04:32:01 AM all 8.30 0.00 4.19 0.02 0.34 87.15 04:32:01 AM 0 16.72 0.00 8.64 0.04 0.43 74.16 04:32:01 AM 1 0.82 0.00 0.23 0.00 0.27 98.68 04:33:01 AM all 4.07 0.00 1.60 0.00 0.18 94.15 04:33:01 AM 0 3.78 0.00 2.92 0.00 0.12 93.19 04:33:01 AM 1 4.36 0.00 0.31 0.00 0.24 95.10 04:34:01 AM all 0.44 0.00 0.10 0.00 0.09 99.37 04:34:01 AM 0 0.27 0.00 0.12 0.00 0.07 99.55 04:34:01 AM 1 0.62 0.00 0.08 0.00 0.12 99.18 04:35:01 AM all 4.98 0.00 1.96 0.01 0.27 92.78 04:35:01 AM 0 6.81 0.00 3.56 0.02 0.26 89.36 04:35:01 AM 1 3.17 0.00 0.37 0.00 0.29 96.16 04:35:01 AM CPU %user %nice %system %iowait %steal %idle 04:36:01 AM all 2.19 0.00 0.23 0.00 0.45 97.13 04:36:01 AM 0 1.39 0.00 0.23 0.00 0.39 97.99 04:36:01 AM 1 2.99 0.00 0.22 0.00 0.52 96.27 04:37:01 AM all 7.90 0.00 2.07 0.00 0.48 89.56 04:37:01 AM 0 9.14 0.00 2.14 0.00 0.49 88.23 04:37:01 AM 1 6.68 0.00 1.99 0.00 0.46 90.87 04:38:01 AM all 0.41 0.00 0.11 0.00 0.18 99.31 04:38:01 AM 0 0.42 0.00 0.10 0.00 0.13 99.35 04:38:01 AM 1 0.40 0.00 0.12 0.00 0.22 99.27 04:39:01 AM all 1.51 0.00 0.18 0.00 0.14 98.17 04:39:01 AM 0 2.61 0.00 0.20 0.00 0.12 97.07 04:39:01 AM 1 0.42 0.00 0.15 0.00 0.17 99.26 04:40:01 AM all 7.70 0.00 2.88 0.00 0.19 89.23 04:40:01 AM 0 15.11 0.00 5.77 0.00 0.25 78.86 04:40:01 AM 1 0.85 0.00 0.22 0.00 0.13 98.80 04:41:01 AM all 5.15 0.00 0.37 0.00 0.16 94.32 04:41:01 AM 0 7.71 0.00 0.52 0.00 0.18 91.58 04:41:01 AM 1 2.59 0.00 0.22 0.00 0.13 97.06 04:42:01 AM all 4.61 0.00 0.33 0.00 0.06 95.00 04:42:01 AM 0 6.55 0.00 0.40 0.00 0.07 92.98 04:42:01 AM 1 2.68 0.00 0.27 0.00 0.05 97.01 04:43:01 AM all 4.34 0.00 0.32 0.00 0.05 95.29 04:43:01 AM 0 3.85 0.00 0.28 0.00 0.05 95.82 04:43:01 AM 1 4.84 0.00 0.35 0.00 0.05 94.76 04:44:01 AM all 4.25 0.00 0.29 0.00 0.07 95.39 04:44:01 AM 0 3.93 0.00 0.23 0.00 0.07 95.77 04:44:01 AM 1 4.57 0.00 0.35 0.00 0.07 95.01 04:45:01 AM all 4.08 0.00 0.29 0.00 0.06 95.57 04:45:01 AM 0 6.62 0.00 0.45 0.00 0.07 92.86 04:45:01 AM 1 1.54 0.00 0.13 0.00 0.05 98.28 04:46:01 AM all 4.68 0.00 0.30 0.00 0.08 94.95 04:46:01 AM 0 7.25 0.00 0.45 0.00 0.08 92.21 04:46:01 AM 1 2.11 0.00 0.15 0.00 0.07 97.68 04:46:01 AM CPU %user %nice %system %iowait %steal %idle 04:47:01 AM all 3.95 0.00 0.22 0.00 0.06 95.78 04:47:01 AM 0 5.36 0.00 0.27 0.00 0.07 94.31 04:47:01 AM 1 2.54 0.00 0.17 0.00 0.05 97.24 04:48:02 AM all 0.48 0.00 0.07 0.00 0.03 99.42 04:48:02 AM 0 0.15 0.00 0.10 0.00 0.03 99.72 04:48:02 AM 1 0.82 0.00 0.03 0.00 0.02 99.13 04:49:01 AM all 0.21 0.00 0.06 0.00 0.03 99.70 04:49:01 AM 0 0.12 0.00 0.07 0.00 0.03 99.78 04:49:01 AM 1 0.31 0.00 0.05 0.00 0.02 99.63 04:50:01 AM all 0.53 0.00 0.09 0.02 0.04 99.32 04:50:01 AM 0 0.48 0.00 0.08 0.03 0.05 99.35 04:50:01 AM 1 0.57 0.00 0.10 0.00 0.03 99.30 04:51:01 AM all 0.33 0.00 0.06 0.00 0.04 99.57 04:51:01 AM 0 0.25 0.00 0.08 0.00 0.05 99.62 04:51:01 AM 1 0.42 0.00 0.03 0.00 0.03 99.52 04:52:01 AM all 0.50 0.00 0.07 0.00 0.03 99.40 04:52:01 AM 0 0.37 0.00 0.08 0.00 0.03 99.52 04:52:01 AM 1 0.63 0.00 0.05 0.00 0.03 99.28 04:53:01 AM all 0.41 0.00 0.08 0.00 0.02 99.50 04:53:01 AM 0 0.12 0.00 0.07 0.00 0.02 99.80 04:53:01 AM 1 0.70 0.00 0.08 0.00 0.02 99.20 04:54:01 AM all 2.74 0.00 0.84 0.00 0.04 96.38 04:54:01 AM 0 5.06 0.00 1.58 0.00 0.05 93.31 04:54:01 AM 1 0.47 0.00 0.12 0.00 0.03 99.38 04:55:01 AM all 5.74 0.00 4.98 0.04 0.05 89.19 04:55:01 AM 0 9.42 0.00 5.69 0.00 0.06 84.84 04:55:01 AM 1 2.43 0.00 4.33 0.07 0.05 93.12 04:56:01 AM all 6.38 0.00 5.32 0.00 0.05 88.24 04:56:01 AM 0 1.10 0.00 0.25 0.00 0.05 98.60 04:56:01 AM 1 12.16 0.00 10.86 0.00 0.05 76.93 04:57:01 AM all 6.13 0.00 4.32 0.03 0.06 89.46 04:57:01 AM 0 3.75 0.00 0.53 0.05 0.05 95.62 04:57:01 AM 1 8.70 0.00 8.40 0.00 0.07 82.82 04:57:01 AM CPU %user %nice %system %iowait %steal %idle 04:58:01 AM all 7.16 0.00 3.93 0.00 0.07 88.85 04:58:01 AM 0 8.09 0.00 7.24 0.00 0.09 84.58 04:58:01 AM 1 6.24 0.00 0.66 0.00 0.05 93.05 04:59:01 AM all 7.19 0.00 4.38 0.00 0.05 88.38 04:59:01 AM 0 6.84 0.00 0.74 0.00 0.05 92.37 04:59:01 AM 1 7.56 0.00 8.11 0.00 0.05 84.28 05:00:01 AM all 7.28 0.00 4.94 0.00 0.06 87.71 05:00:01 AM 0 11.75 0.00 9.55 0.00 0.07 78.63 05:00:01 AM 1 2.90 0.00 0.43 0.00 0.05 96.62 05:01:01 AM all 14.06 0.00 4.54 0.00 0.06 81.35 05:01:01 AM 0 18.17 0.00 0.80 0.00 0.07 80.96 05:01:01 AM 1 9.65 0.00 8.54 0.00 0.05 81.76 05:02:01 AM all 21.97 0.00 2.49 0.60 0.07 74.88 05:02:01 AM 0 29.52 0.00 2.89 0.43 0.07 67.10 05:02:01 AM 1 14.42 0.00 2.09 0.77 0.07 82.66 05:03:01 AM all 37.46 0.00 3.67 0.38 0.12 58.38 05:03:01 AM 0 30.93 0.00 3.47 0.38 0.12 65.09 05:03:01 AM 1 43.98 0.00 3.86 0.37 0.12 51.68 Average: all 3.40 0.01 0.62 0.01 0.16 95.80 Average: 0 3.84 0.01 0.67 0.01 0.16 95.31 Average: 1 2.96 0.00 0.57 0.01 0.16 96.30