Started by upstream project "integration-distribution-mri-test-calcium" build number 49 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-11625 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-calcium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-gTLhYHX6OoUx/agent.5288 SSH_AGENT_PID=5289 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-calcium@tmp/private_key_4736644467267751723.key (/w/workspace/controller-csit-3node-clustering-tell-all-calcium@tmp/private_key_4736644467267751723.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test@tmp/jenkins-gitclient-ssh15848870780794575229.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test@tmp/jenkins-gitclient-ssh14377077408348232193.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision d44028c31b5eacf751ef387bb332298238e8af70 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f d44028c31b5eacf751ef387bb332298238e8af70 # timeout=10 Commit message: "Adapt python scripts to RFC 8040 (odl-lispflowmapping-performance-tests)" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk c25faeb6777dcdbed566c60e0c61adeb8b295472 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins6495244955344559624.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-bp6v lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH Generating Requirements File Python 3.11.7 pip 24.2 from /tmp/venv-bp6v/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.5.0 aspy.yaml==1.3.0 attrs==24.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.35.0 botocore==1.35.0 bs4==0.0.2 cachetools==5.4.0 certifi==2024.7.4 cffi==1.17.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.7.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.6.1 docker==4.2.2 dogpile.cache==1.3.3 email_validator==2.2.0 filelock==3.15.4 future==1.0.0 gitdb==4.0.11 GitPython==3.1.43 google-auth==2.33.0 httplib2==0.22.0 identify==2.6.0 idna==3.7 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.4 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.23.0 jsonschema-specifications==2023.12.1 keystoneauth1==5.7.0 kubernetes==30.1.0 lftools==0.37.10 lxml==5.3.0 MarkupSafe==2.1.5 msgpack==1.0.8 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 netifaces==0.11.0 niet==1.4.2 nodeenv==1.9.1 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==3.3.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.1.0 oslo.config==9.5.0 oslo.context==5.5.0 oslo.i18n==6.3.0 oslo.log==6.1.1 oslo.serialization==5.5.0 oslo.utils==7.2.0 packaging==24.1 pbr==6.0.0 platformdirs==4.2.2 prettytable==3.11.0 pyasn1==0.6.0 pyasn1_modules==0.4.0 pycparser==2.22 pygerrit2==2.0.15 PyGithub==2.3.0 PyJWT==2.9.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.9.0 pyrsistent==0.20.0 python-cinderclient==9.5.0 python-dateutil==2.9.0.post0 python-heatclient==3.5.0 python-jenkins==1.8.2 python-keystoneclient==5.4.0 python-magnumclient==4.6.0 python-openstackclient==7.0.0 python-swiftclient==4.6.0 PyYAML==6.0.2 referencing==0.35.1 requests==2.32.3 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.20.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.2 simplejson==3.19.3 six==1.16.0 smmap==5.0.1 soupsieve==2.6 stevedore==5.2.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.13.2 tqdm==4.66.5 typing_extensions==4.12.2 tzdata==2024.1 urllib3==1.26.19 virtualenv==20.26.3 wcwidth==0.2.13 websocket-client==1.8.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-calcium-49 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins2335655597591634584.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240601-160217.263' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' job_name: '28865-49' silo: 'releng' [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins11489376541623791634.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-ZwFQ + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ tail -n 1 +++ sort -V ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-bp6v + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from file:/tmp/.os_lf_venv + /tmp/venv-bp6v/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-bp6v/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH + PATH=/tmp/venv-bp6v/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 679936 | | totalCoresUsed | 166 | | totalInstancesUsed | 54 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 1 | | totalGigabytesUsed | 20 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-calcium + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-calcium-49 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-calcium/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-tell-all-calcium-49 Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2024-08-18T00:26:04Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': 'cc709cfd-a59f-4df9-a7fc-436cbaa742e8', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-calcium-49/cc709cfd-a59f-4df9-a7fc-436cbaa742e8', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-tell-all-calcium-49', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}, {'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.170.54', '10.30.170.178', '10.30.170.26']}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': 'cc709cfd-a59f-4df9-a7fc-436cbaa742e8', 'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-calcium-49', 'job_name': '28865-49', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - ' '20240601-160217.263', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - ' '20230601-180106.003'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': '2018c9d884be4692a90426164ac8db2e'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-tell-all-calcium [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins16749913784576763430.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH SSH not responding on 10.30.170.26. Retrying in 10 seconds... SSH not responding on 10.30.170.178. Retrying in 10 seconds... SSH not responding on 10.30.170.54. Retrying in 10 seconds... Ping to 10.30.170.26 successful. Ping to 10.30.170.178 successful. Ping to 10.30.170.54 successful. SSH not responding on 10.30.170.178. Retrying in 10 seconds... SSH not responding on 10.30.170.26. Retrying in 10 seconds... SSH not responding on 10.30.170.54. Retrying in 10 seconds... Ping to 10.30.170.178 successful. Ping to 10.30.170.26 successful. Ping to 10.30.170.54 successful. SSH not responding on 10.30.170.54. Retrying in 10 seconds... SSH not responding on 10.30.170.178. Retrying in 10 seconds... Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. 10.30.170.26 releng-28865-49-0-builder-2.novalocal Successfully copied public keys to slave 10.30.170.26 Ping to 10.30.170.54 successful. Ping to 10.30.170.178 successful. Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. 10.30.170.178 releng-28865-49-0-builder-1.novalocal Successfully copied public keys to slave 10.30.170.178 10.30.170.54 releng-28865-49-0-builder-0.novalocal Successfully copied public keys to slave 10.30.170.54 Process 6685 ready. Process 6686 ready. Process 6687 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins6962182437049544182.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-lp3r lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.robot_venv lf-activate-venv(): INFO: Installing: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-lp3r/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB) Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.3/requests-2.32.3-py3-none-any.whl (64 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0.1/robotframework-7.0.1-py3-none-any.whl (727 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 727.6/727.6 kB 29.8 MB/s eta 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 19.5 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.15.0/elasticsearch-8.15.0-py3-none-any.whl (523 kB) Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.0/elasticsearch_dsl-8.15.0-py3-none-any.whl (104 kB) Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB) Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB) Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.1/paramiko-3.4.1-py3-none-any.whl (226 kB) Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.8.0/websocket_client-1.8.0-py3-none-any.whl (58 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB) Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.7/idna-3.7-py3-none-any.whl (66 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.2/urllib3-2.2.2-py3-none-any.whl (121 kB) Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.7.4/certifi-2024.7.4-py3-none-any.whl (162 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.5.0/robotframework_seleniumlibrary-6.5.0-py2.py3-none-any.whl (104 kB) Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.15.0/elastic_transport-8.15.0-py3-none-any.whl (64 kB) Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting typing-extensions (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.12.2/typing_extensions-4.12.2-py3-none-any.whl (37 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.1/pyang-2.6.1-py2.py3-none-any.whl (594 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.7/594.7 kB 28.3 MB/s eta 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.3.0/lxml-5.3.0-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2024.7.24/regex-2024.7.24-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (786 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 786.6/786.6 kB 9.8 MB/s eta 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.2.0/bcrypt-4.2.0-cp39-abi3-manylinux_2_28_x86_64.whl (273 kB) Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/43.0.0/cryptography-43.0.0-cp39-abi3-manylinux_2_28_x86_64.whl (4.0 MB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.23.1/selenium-4.23.1-py3-none-any.whl (9.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.4/9.4 MB 32.6 MB/s eta 0:00:00 Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) Collecting click>=8.1.7 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.1.7/click-8.1.7-py3-none-any.whl (97 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.8/WebOb-1.8.8-py2.py3-none-any.whl (115 kB) Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB) Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.17.0/cffi-1.17.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (466 kB) Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.26.2/trio-0.26.2-py3-none-any.whl (475 kB) Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.6/soupsieve-2.6-py3-none-any.whl (36 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB) Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/24.2.0/attrs-24.2.0-py3-none-any.whl (63 kB) Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) Building wheels for collected packages: robotframework-sshlibrary, ipaddr, robotframework-httplibrary, scapy, jsonpath-rw Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55118 sha256=cf933e9613a5df8922e58b76accc4e153d6a9f5e8cb7bf44fd5ef2225527fbdb Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18281 sha256=71d8b9a515125694ff24fe157157dd6de75a09232057abaac62a68fe89fa58c6 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9956 sha256=6024d96958c98406c52572d46c2640adbe5d97fc4bfcd83b96e9ec8b96d6213f Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed Building wheel for scapy (setup.py): started Building wheel for scapy (setup.py): finished with status 'done' Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444322 sha256=f6ea601809d871a5115e855d583f6bcced964048ce6318128fbe4f14b9e4efca Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15128 sha256=510af5c0ae64a45fb30fd7f5cc3e24ddc74b81c29e551d501d0eb02e6d26f2e3 Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr robotframework-httplibrary scapy jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, click, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.8 attrs-24.2.0 bcrypt-4.2.0 beautifulsoup4-4.12.3 certifi-2024.7.4 cffi-1.17.0 charset-normalizer-3.3.2 click-8.1.7 cryptography-43.0.0 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.15.0 elasticsearch-8.15.0 elasticsearch-dsl-8.15.0 enum34-1.1.10 h11-0.14.0 idna-3.7 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-5.3.0 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.1 ply-3.11 pyang-2.6.1 pyangbind-0.8.6 pycparser-2.22 pyhocon-0.3.61 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2024.7.24 requests-2.32.3 robotframework-7.0.1 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.5.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.15.0 selenium-4.23.1 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.6 trio-0.26.2 trio-websocket-0.11.1 typing-extensions-4.12.2 urllib3-2.2.2 waitress-3.0.0 websocket-client-1.8.0 webtest-3.0.0 wsproto-1.2.0 + pip freeze attrs==24.2.0 bcrypt==4.2.0 beautifulsoup4==4.12.3 certifi==2024.7.4 cffi==1.17.0 charset-normalizer==3.3.2 click==8.1.7 cryptography==43.0.0 decorator==5.1.1 distlib==0.3.8 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.15.0 elasticsearch==8.15.0 elasticsearch-dsl==8.15.0 enum34==1.1.10 filelock==3.15.4 h11==0.14.0 idna==3.7 ipaddr==2.2.0 isodate==0.6.1 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==3.0.0 lxml==5.3.0 netaddr==1.3.0 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==3.4.1 platformdirs==4.2.2 ply==3.11 pyang==2.6.1 pyangbind==0.8.6 pycparser==2.22 pyhocon==0.3.61 PyNaCl==1.5.0 pyparsing==3.1.2 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2024.7.24 requests==2.32.3 robotframework==7.0.1 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.4.1 robotframework-requests==0.9.7 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.5.0 robotframework-sshlibrary==3.8.0 scapy==2.5.0 scp==0.15.0 selenium==4.23.1 six==1.16.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.6 trio==0.26.2 trio-websocket==0.11.1 typing_extensions==4.12.2 urllib3==2.2.2 virtualenv==20.26.3 waitress==3.0.0 WebOb==1.8.8 websocket-client==1.8.0 WebTest==3.0.0 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins10628397183381726005.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.2 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-calcium-49 ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' + for i in "${ADDR[@]}" ++ ssh 10.30.170.54 hostname -s Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + REMHOST=releng-28865-49-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.178 hostname -s Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + REMHOST=releng-28865-49-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.26 hostname -s Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + REMHOST=releng-28865-49-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.170.54 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.170.54 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.170.178 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.170.26 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.170.54 ODL_SYSTEM_1_IP=10.30.170.54 ODL_SYSTEM_2_IP=10.30.170.178 ODL_SYSTEM_3_IP=10.30.170.26 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/sh /tmp/jenkins9030171354617006712.sh Preparing for JRE Version 17 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-17-openjdk [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins7102943455033448831.sh --2024-08-18 00:28:14-- http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/calcium Resolving git.opendaylight.org (git.opendaylight.org)... 35.181.223.58, 13.39.230.180, 52.47.161.242, ... Connecting to git.opendaylight.org (git.opendaylight.org)|35.181.223.58|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 2619 (2.6K) [text/plain] Saving to: ‘pom.xml’ 0K .. 100% 239M=0s 2024-08-18 00:28:14 (239 MB/s) - ‘pom.xml’ saved [2619/2619] Bundle version is 0.20.2-SNAPSHOT --2024-08-18 00:28:14-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 49.3M=0s 2024-08-18 00:28:14 (49.3 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.20.2-SNAPSHOT 20240817.204827 277 20240817204827 pom 0.20.2-20240817.204827-277 20240817204827 tar.gz 0.20.2-20240817.204827-277 20240817204827 zip 0.20.2-20240817.204827-277 20240817204827 cyclonedx xml 0.20.2-20240817.204827-277 20240817204827 cyclonedx json 0.20.2-20240817.204827-277 20240817204827 Nexus timestamp is 0.20.2-20240817.204827-277 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip Distribution bundle is karaf-0.20.2-20240817.204827-277.zip Distribution bundle version is 0.20.2-SNAPSHOT Distribution folder is karaf-0.20.2-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins17684875238813864544.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.170.54:/tmp Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.178:/tmp Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.26:/tmp Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins2178202789038946116.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.170.54 Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.170.178 Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.170.26 Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.170.54 Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.20.2-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.20.2-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.20.2-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.20.2-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip --2024-08-18 00:28:28-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 268191098 (256M) [application/zip] Saving to: ‘karaf-0.20.2-20240817.204827-277.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 78.3M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 134M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 140M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 153M 2s 12288K ........ ........ ........ ........ ........ ........ 5% 151M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 179M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 158M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 190M 2s 24576K ........ ........ ........ ........ ........ ........ 10% 201M 2s 27648K ........ ........ ........ ........ ........ ........ 11% 205M 2s 30720K ........ ........ ........ ........ ........ ........ 12% 183M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 219M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 159M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 238M 1s 43008K ........ ........ ........ ........ ........ ........ 17% 197M 1s 46080K ........ ........ ........ ........ ........ ........ 18% 167M 1s 49152K ........ ........ ........ ........ ........ ........ 19% 229M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 117M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 195M 1s 58368K ........ ........ ........ ........ ........ ........ 23% 172M 1s 61440K ........ ........ ........ ........ ........ ........ 24% 243M 1s 64512K ........ ........ ........ ........ ........ ........ 25% 126M 1s 67584K ........ ........ ........ ........ ........ ........ 26% 292M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 238M 1s 73728K ........ ........ ........ ........ ........ ........ 29% 236M 1s 76800K ........ ........ ........ ........ ........ ........ 30% 233M 1s 79872K ........ ........ ........ ........ ........ ........ 31% 258M 1s 82944K ........ ........ ........ ........ ........ ........ 32% 222M 1s 86016K ........ ........ ........ ........ ........ ........ 34% 199M 1s 89088K ........ ........ ........ ........ ........ ........ 35% 129M 1s 92160K ........ ........ ........ ........ ........ ........ 36% 363M 1s 95232K ........ ........ ........ ........ ........ ........ 37% 151M 1s 98304K ........ ........ ........ ........ ........ ........ 38% 221M 1s 101376K ........ ........ ........ ........ ........ ........ 39% 358M 1s 104448K ........ ........ ........ ........ ........ ........ 41% 236M 1s 107520K ........ ........ ........ ........ ........ ........ 42% 346M 1s 110592K ........ ........ ........ ........ ........ ........ 43% 359M 1s 113664K ........ ........ ........ ........ ........ ........ 44% 328M 1s 116736K ........ ........ ........ ........ ........ ........ 45% 197M 1s 119808K ........ ........ ........ ........ ........ ........ 46% 319M 1s 122880K ........ ........ ........ ........ ........ ........ 48% 87.1M 1s 125952K ........ ........ ........ ........ ........ ........ 49% 290M 1s 129024K ........ ........ ........ ........ ........ ........ 50% 340M 1s 132096K ........ ........ ........ ........ ........ ........ 51% 270M 1s 135168K ........ ........ ........ ........ ........ ........ 52% 290M 1s 138240K ........ ........ ........ ........ ........ ........ 53% 248M 1s 141312K ........ ........ ........ ........ ........ ........ 55% 275M 1s 144384K ........ ........ ........ ........ ........ ........ 56% 201M 1s 147456K ........ ........ ........ ........ ........ ........ 57% 230M 1s 150528K ........ ........ ........ ........ ........ ........ 58% 133M 1s 153600K ........ ........ ........ ........ ........ ........ 59% 356M 1s 156672K ........ ........ ........ ........ ........ ........ 60% 122M 1s 159744K ........ ........ ........ ........ ........ ........ 62% 248M 1s 162816K ........ ........ ........ ........ ........ ........ 63% 269M 0s 165888K ........ ........ ........ ........ ........ ........ 64% 263M 0s 168960K ........ ........ ........ ........ ........ ........ 65% 176M 0s 172032K ........ ........ ........ ........ ........ ........ 66% 254M 0s 175104K ........ ........ ........ ........ ........ ........ 68% 217M 0s 178176K ........ ........ ........ ........ ........ ........ 69% 225M 0s 181248K ........ ........ ........ ........ ........ ........ 70% 257M 0s 184320K ........ ........ ........ ........ ........ ........ 71% 214M 0s 187392K ........ ........ ........ ........ ........ ........ 72% 241M 0s 190464K ........ ........ ........ ........ ........ ........ 73% 259M 0s 193536K ........ ........ ........ ........ ........ ........ 75% 199M 0s 196608K ........ ........ ........ ........ ........ ........ 76% 232M 0s 199680K ........ ........ ........ ........ ........ ........ 77% 128M 0s 202752K ........ ........ ........ ........ ........ ........ 78% 169M 0s 205824K ........ ........ ........ ........ ........ ........ 79% 279M 0s 208896K ........ ........ ........ ........ ........ ........ 80% 272M 0s 211968K ........ ........ ........ ........ ........ ........ 82% 239M 0s 215040K ........ ........ ........ ........ ........ ........ 83% 242M 0s 218112K ........ ........ ........ ........ ........ ........ 84% 260M 0s 221184K ........ ........ ........ ........ ........ ........ 85% 197M 0s 224256K ........ ........ ........ ........ ........ ........ 86% 173M 0s 227328K ........ ........ ........ ........ ........ ........ 87% 79.8M 0s 230400K ........ ........ ........ ........ ........ ........ 89% 145M 0s 233472K ........ ........ ........ ........ ........ ........ 90% 186M 0s 236544K ........ ........ ........ ........ ........ ........ 91% 160M 0s 239616K ........ ........ ........ ........ ........ ........ 92% 167M 0s 242688K ........ ........ ........ ........ ........ ........ 93% 154M 0s 245760K ........ ........ ........ ........ ........ ........ 95% 125M 0s 248832K ........ ........ ........ ........ ........ ........ 96% 44.6M 0s 251904K ........ ........ ........ ........ ........ ........ 97% 200M 0s 254976K ........ ........ ........ ........ ........ ........ 98% 158M 0s 258048K ........ ........ ........ ........ ........ ........ 99% 198M 0s 261120K ........ .... 100% 167M=1.4s 2024-08-18 00:28:29 (184 MB/s) - ‘karaf-0.20.2-20240817.204827-277.zip’ saved [268191098/268191098] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.20.2-20240817.204827-277.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] Configuring the startup features... + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.20.2-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/2151e9da-45c7-4399-9919-690517424a41.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, b27d0d1b-0db9-4aa5-a5fd-50d310cb2033 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' controllerdebugmap: + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m Configure java home: /usr/lib/jvm/java-17-openjdk + local -r memconf=/tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' max memory: 3072m memconf: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + echo ' memconf: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv cat /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true + echo 'Set Java version' Set Java version + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.170.54:48264 199.204.45.87:443 TIME_WAIT - tcp 0 0 10.30.170.54:22 10.30.170.229:55508 ESTABLISHED - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.170.54:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - Custom shard config exists!!! Copying the shard config... Configuring cluster ################################################ ## Configure Cluster ## ################################################ + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.2-SNAPSHOT/bin/ + echo 'Configuring cluster' + /tmp/karaf-0.20.2-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.54 10.30.170.178 10.30.170.26 NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.20.2-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.4 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.54" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.54:2550", "akka://opendaylight-cluster-data@10.30.170.178:2550", "akka://opendaylight-cluster-data@10.30.170.26:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.170.178 Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.20.2-SNAPSHOT common-functions.sh is being sourced ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.20.2-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.20.2-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.20.2-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip --2024-08-18 00:28:33-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 268191098 (256M) [application/zip] Saving to: ‘karaf-0.20.2-20240817.204827-277.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 111M 2s 3072K ........ ........ ........ ........ ........ ........ 2% 132M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 133M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 147M 2s 12288K ........ ........ ........ ........ ........ ........ 5% 133M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 157M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 121M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 187M 2s 24576K ........ ........ ........ ........ ........ ........ 10% 203M 2s 27648K ........ ........ ........ ........ ........ ........ 11% 216M 2s 30720K ........ ........ ........ ........ ........ ........ 12% 259M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 246M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 276M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 254M 1s 43008K ........ ........ ........ ........ ........ ........ 17% 260M 1s 46080K ........ ........ ........ ........ ........ ........ 18% 381M 1s 49152K ........ ........ ........ ........ ........ ........ 19% 347M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 289M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 296M 1s 58368K ........ ........ ........ ........ ........ ........ 23% 298M 1s 61440K ........ ........ ........ ........ ........ ........ 24% 293M 1s 64512K ........ ........ ........ ........ ........ ........ 25% 285M 1s 67584K ........ ........ ........ ........ ........ ........ 26% 282M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 291M 1s 73728K ........ ........ ........ ........ ........ ........ 29% 287M 1s 76800K ........ ........ ........ ........ ........ ........ 30% 289M 1s 79872K ........ ........ ........ ........ ........ ........ 31% 286M 1s 82944K ........ ........ ........ ........ ........ ........ 32% 149M 1s 86016K ........ ........ ........ ........ ........ ........ 34% 269M 1s 89088K ........ ........ ........ ........ ........ ........ 35% 318M 1s 92160K ........ ........ ........ ........ ........ ........ 36% 300M 1s 95232K ........ ........ ........ ........ ........ ........ 37% 280M 1s 98304K ........ ........ ........ ........ ........ ........ 38% 276M 1s 101376K ........ ........ ........ ........ ........ ........ 39% 308M 1s 104448K ........ ........ ........ ........ ........ ........ 41% 196M 1s 107520K ........ ........ ........ ........ ........ ........ 42% 387M 1s 110592K ........ ........ ........ ........ ........ ........ 43% 398M 1s 113664K ........ ........ ........ ........ ........ ........ 44% 262M 1s 116736K ........ ........ ........ ........ ........ ........ 45% 285M 1s 119808K ........ ........ ........ ........ ........ ........ 46% 266M 1s 122880K ........ ........ ........ ........ ........ ........ 48% 294M 1s 125952K ........ ........ ........ ........ ........ ........ 49% 277M 1s 129024K ........ ........ ........ ........ ........ ........ 50% 274M 1s 132096K ........ ........ ........ ........ ........ ........ 51% 278M 1s 135168K ........ ........ ........ ........ ........ ........ 52% 269M 1s 138240K ........ ........ ........ ........ ........ ........ 53% 264M 1s 141312K ........ ........ ........ ........ ........ ........ 55% 314M 0s 144384K ........ ........ ........ ........ ........ ........ 56% 289M 0s 147456K ........ ........ ........ ........ ........ ........ 57% 268M 0s 150528K ........ ........ ........ ........ ........ ........ 58% 259M 0s 153600K ........ ........ ........ ........ ........ ........ 59% 289M 0s 156672K ........ ........ ........ ........ ........ ........ 60% 176M 0s 159744K ........ ........ ........ ........ ........ ........ 62% 278M 0s 162816K ........ ........ ........ ........ ........ ........ 63% 201M 0s 165888K ........ ........ ........ ........ ........ ........ 64% 236M 0s 168960K ........ ........ ........ ........ ........ ........ 65% 228M 0s 172032K ........ ........ ........ ........ ........ ........ 66% 228M 0s 175104K ........ ........ ........ ........ ........ ........ 68% 231M 0s 178176K ........ ........ ........ ........ ........ ........ 69% 229M 0s 181248K ........ ........ ........ ........ ........ ........ 70% 211M 0s 184320K ........ ........ ........ ........ ........ ........ 71% 235M 0s 187392K ........ ........ ........ ........ ........ ........ 72% 214M 0s 190464K ........ ........ ........ ........ ........ ........ 73% 217M 0s 193536K ........ ........ ........ ........ ........ ........ 75% 246M 0s 196608K ........ ........ ........ ........ ........ ........ 76% 291M 0s 199680K ........ ........ ........ ........ ........ ........ 77% 301M 0s 202752K ........ ........ ........ ........ ........ ........ 78% 281M 0s 205824K ........ ........ ........ ........ ........ ........ 79% 244M 0s 208896K ........ ........ ........ ........ ........ ........ 80% 272M 0s 211968K ........ ........ ........ ........ ........ ........ 82% 282M 0s 215040K ........ ........ ........ ........ ........ ........ 83% 275M 0s 218112K ........ ........ ........ ........ ........ ........ 84% 308M 0s 221184K ........ ........ ........ ........ ........ ........ 85% 295M 0s 224256K ........ ........ ........ ........ ........ ........ 86% 289M 0s 227328K ........ ........ ........ ........ ........ ........ 87% 284M 0s 230400K ........ ........ ........ ........ ........ ........ 89% 283M 0s 233472K ........ ........ ........ ........ ........ ........ 90% 277M 0s 236544K ........ ........ ........ ........ ........ ........ 91% 294M 0s 239616K ........ ........ ........ ........ ........ ........ 92% 292M 0s 242688K ........ ........ ........ ........ ........ ........ 93% 290M 0s 245760K ........ ........ ........ ........ ........ ........ 95% 297M 0s 248832K ........ ........ ........ ........ ........ ........ 96% 290M 0s 251904K ........ ........ ........ ........ ........ ........ 97% 300M 0s 254976K ........ ........ ........ ........ ........ ........ 98% 292M 0s 258048K ........ ........ ........ ........ ........ ........ 99% 297M 0s 261120K ........ .... 100% 285M=1.0s 2024-08-18 00:28:34 (245 MB/s) - ‘karaf-0.20.2-20240817.204827-277.zip’ saved [268191098/268191098] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.20.2-20240817.204827-277.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] Configuring the startup features... + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.20.2-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/2151e9da-45c7-4399-9919-690517424a41.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, b27d0d1b-0db9-4aa5-a5fd-50d310cb2033 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS controllerdebugmap: + echo 'controllerdebugmap: ' + '[' -n '' ']' cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv' cat /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + cat /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.178:22 10.30.170.229:52076 ESTABLISHED - tcp 0 0 10.30.170.178:44190 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.170.178:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' Custom shard config exists!!! Copying the shard config... + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.2-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.20.2-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.54 10.30.170.178 10.30.170.26 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.20.2-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.4 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.178" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.54:2550", "akka://opendaylight-cluster-data@10.30.170.178:2550", "akka://opendaylight-cluster-data@10.30.170.26:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.170.26 Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.20.2-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.20.2-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.20.2-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.20.2-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip --2024-08-18 00:28:38-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 268191098 (256M) [application/zip] Saving to: ‘karaf-0.20.2-20240817.204827-277.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 76.7M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 143M 3s 6144K ........ ........ ........ ........ ........ ........ 3% 161M 2s 9216K ........ ........ ........ ........ ........ ........ 4% 187M 2s 12288K ........ ........ ........ ........ ........ ........ 5% 203M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 246M 2s 18432K ........ ........ ........ ........ ........ ........ 8% 206M 2s 21504K ........ ........ ........ ........ ........ ........ 9% 216M 1s 24576K ........ ........ ........ ........ ........ ........ 10% 214M 1s 27648K ........ ........ ........ ........ ........ ........ 11% 239M 1s 30720K ........ ........ ........ ........ ........ ........ 12% 203M 1s 33792K ........ ........ ........ ........ ........ ........ 14% 219M 1s 36864K ........ ........ ........ ........ ........ ........ 15% 206M 1s 39936K ........ ........ ........ ........ ........ ........ 16% 218M 1s 43008K ........ ........ ........ ........ ........ ........ 17% 237M 1s 46080K ........ ........ ........ ........ ........ ........ 18% 213M 1s 49152K ........ ........ ........ ........ ........ ........ 19% 225M 1s 52224K ........ ........ ........ ........ ........ ........ 21% 226M 1s 55296K ........ ........ ........ ........ ........ ........ 22% 223M 1s 58368K ........ ........ ........ ........ ........ ........ 23% 217M 1s 61440K ........ ........ ........ ........ ........ ........ 24% 191M 1s 64512K ........ ........ ........ ........ ........ ........ 25% 268M 1s 67584K ........ ........ ........ ........ ........ ........ 26% 191M 1s 70656K ........ ........ ........ ........ ........ ........ 28% 252M 1s 73728K ........ ........ ........ ........ ........ ........ 29% 271M 1s 76800K ........ ........ ........ ........ ........ ........ 30% 185M 1s 79872K ........ ........ ........ ........ ........ ........ 31% 221M 1s 82944K ........ ........ ........ ........ ........ ........ 32% 245M 1s 86016K ........ ........ ........ ........ ........ ........ 34% 218M 1s 89088K ........ ........ ........ ........ ........ ........ 35% 212M 1s 92160K ........ ........ ........ ........ ........ ........ 36% 177M 1s 95232K ........ ........ ........ ........ ........ ........ 37% 181M 1s 98304K ........ ........ ........ ........ ........ ........ 38% 234M 1s 101376K ........ ........ ........ ........ ........ ........ 39% 221M 1s 104448K ........ ........ ........ ........ ........ ........ 41% 260M 1s 107520K ........ ........ ........ ........ ........ ........ 42% 239M 1s 110592K ........ ........ ........ ........ ........ ........ 43% 242M 1s 113664K ........ ........ ........ ........ ........ ........ 44% 222M 1s 116736K ........ ........ ........ ........ ........ ........ 45% 194M 1s 119808K ........ ........ ........ ........ ........ ........ 46% 205M 1s 122880K ........ ........ ........ ........ ........ ........ 48% 187M 1s 125952K ........ ........ ........ ........ ........ ........ 49% 221M 1s 129024K ........ ........ ........ ........ ........ ........ 50% 227M 1s 132096K ........ ........ ........ ........ ........ ........ 51% 224M 1s 135168K ........ ........ ........ ........ ........ ........ 52% 224M 1s 138240K ........ ........ ........ ........ ........ ........ 53% 195M 1s 141312K ........ ........ ........ ........ ........ ........ 55% 180M 1s 144384K ........ ........ ........ ........ ........ ........ 56% 150M 1s 147456K ........ ........ ........ ........ ........ ........ 57% 148M 1s 150528K ........ ........ ........ ........ ........ ........ 58% 130M 1s 153600K ........ ........ ........ ........ ........ ........ 59% 136M 1s 156672K ........ ........ ........ ........ ........ ........ 60% 139M 1s 159744K ........ ........ ........ ........ ........ ........ 62% 135M 0s 162816K ........ ........ ........ ........ ........ ........ 63% 119M 0s 165888K ........ ........ ........ ........ ........ ........ 64% 163M 0s 168960K ........ ........ ........ ........ ........ ........ 65% 174M 0s 172032K ........ ........ ........ ........ ........ ........ 66% 197M 0s 175104K ........ ........ ........ ........ ........ ........ 68% 181M 0s 178176K ........ ........ ........ ........ ........ ........ 69% 185M 0s 181248K ........ ........ ........ ........ ........ ........ 70% 168M 0s 184320K ........ ........ ........ ........ ........ ........ 71% 169M 0s 187392K ........ ........ ........ ........ ........ ........ 72% 154M 0s 190464K ........ ........ ........ ........ ........ ........ 73% 174M 0s 193536K ........ ........ ........ ........ ........ ........ 75% 189M 0s 196608K ........ ........ ........ ........ ........ ........ 76% 179M 0s 199680K ........ ........ ........ ........ ........ ........ 77% 186M 0s 202752K ........ ........ ........ ........ ........ ........ 78% 172M 0s 205824K ........ ........ ........ ........ ........ ........ 79% 207M 0s 208896K ........ ........ ........ ........ ........ ........ 80% 194M 0s 211968K ........ ........ ........ ........ ........ ........ 82% 183M 0s 215040K ........ ........ ........ ........ ........ ........ 83% 99.1M 0s 218112K ........ ........ ........ ........ ........ ........ 84% 123M 0s 221184K ........ ........ ........ ........ ........ ........ 85% 149M 0s 224256K ........ ........ ........ ........ ........ ........ 86% 180M 0s 227328K ........ ........ ........ ........ ........ ........ 87% 171M 0s 230400K ........ ........ ........ ........ ........ ........ 89% 152M 0s 233472K ........ ........ ........ ........ ........ ........ 90% 163M 0s 236544K ........ ........ ........ ........ ........ ........ 91% 173M 0s 239616K ........ ........ ........ ........ ........ ........ 92% 199M 0s 242688K ........ ........ ........ ........ ........ ........ 93% 182M 0s 245760K ........ ........ ........ ........ ........ ........ 95% 187M 0s 248832K ........ ........ ........ ........ ........ ........ 96% 196M 0s 251904K ........ ........ ........ ........ ........ ........ 97% 216M 0s 254976K ........ ........ ........ ........ ........ ........ 98% 201M 0s 258048K ........ ........ ........ ........ ........ ........ 99% 188M 0s 261120K ........ .... 100% 218M=1.4s 2024-08-18 00:28:40 (184 MB/s) - ‘karaf-0.20.2-20240817.204827-277.zip’ saved [268191098/268191098] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.20.2-20240817.204827-277.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.20.2-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.20.2-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/2151e9da-45c7-4399-9919-690517424a41.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, b27d0d1b-0db9-4aa5-a5fd-50d310cb2033 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS controllerdebugmap: cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + echo Configure Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' memconf: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + echo ' memconf: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv cat /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.170.26:22 10.30.170.229:40344 ESTABLISHED - tcp 0 0 10.30.170.26:54848 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.170.26:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.20.2-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.20.2-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.54 10.30.170.178 10.30.170.26 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.20.2-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/9.0.4 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.26" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.54:2550", "akka://opendaylight-cluster-data@10.30.170.178:2550", "akka://opendaylight-cluster-data@10.30.170.26:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.170.54 Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.170.178 Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.170.26 Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins15774510929517081073.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.20.2-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.20.2-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.20.2-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.20.2-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.170.54' Execute the post startup script on controller 10.30.170.54 + scp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/post-startup-script.sh 10.30.170.54:/tmp/ Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + ssh 10.30.170.54 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-08-18T00:29:42,204 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 299 - org.opendaylight.infrautils.ready-api - 6.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-08-18T00:29:42,204 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 299 - org.opendaylight.infrautils.ready-api - 6.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.54:22 10.30.170.229:57200 ESTABLISHED - tcp6 0 0 127.0.0.1:43469 :::* LISTEN 5748/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5748/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5748/java tcp6 0 0 10.30.170.54:2550 :::* LISTEN 5748/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::12345 :::* LISTEN 5748/java tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5748/java tcp6 0 0 :::6653 :::* LISTEN 5748/java tcp6 0 0 :::4189 :::* LISTEN 5748/java tcp6 0 0 :::1790 :::* LISTEN 5748/java tcp6 0 0 :::8101 :::* LISTEN 5748/java tcp6 0 0 :::6633 :::* LISTEN 5748/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5748/java tcp6 0 0 10.30.170.54:2550 10.30.170.26:38754 ESTABLISHED 5748/java tcp6 0 0 10.30.170.54:49330 10.30.170.26:2550 ESTABLISHED 5748/java tcp6 0 0 127.0.0.1:47850 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.54:2550 10.30.170.178:57478 ESTABLISHED 5748/java tcp6 32 0 10.30.170.54:52426 199.204.45.87:443 CLOSE_WAIT 5748/java tcp6 0 0 10.30.170.54:2550 10.30.170.178:57474 ESTABLISHED 5748/java tcp6 0 0 10.30.170.54:49336 10.30.170.26:2550 ESTABLISHED 5748/java tcp6 0 0 10.30.170.54:49814 10.30.170.178:2550 ESTABLISHED 5748/java tcp6 0 0 127.0.0.1:38712 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.54:49808 10.30.170.178:2550 ESTABLISHED 5748/java tcp6 0 0 10.30.170.54:2550 10.30.170.26:38770 ESTABLISHED 5748/java tcp6 0 0 127.0.0.1:47754 127.0.0.1:1099 TIME_WAIT - udp 0 0 10.30.170.54:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5748/java looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.170.178' Execute the post startup script on controller 10.30.170.178 + scp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/post-startup-script.sh 10.30.170.178:/tmp/ Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + ssh 10.30.170.178 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-08-18T00:29:42,669 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 299 - org.opendaylight.infrautils.ready-api - 6.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-08-18T00:29:42,669 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 299 - org.opendaylight.infrautils.ready-api - 6.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.178:22 10.30.170.229:49620 ESTABLISHED - tcp6 0 0 :::8101 :::* LISTEN 5784/java tcp6 0 0 :::6633 :::* LISTEN 5784/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5784/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5784/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5784/java tcp6 0 0 127.0.0.1:39925 :::* LISTEN 5784/java tcp6 0 0 10.30.170.178:2550 :::* LISTEN 5784/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5784/java tcp6 0 0 :::6653 :::* LISTEN 5784/java tcp6 0 0 :::1790 :::* LISTEN 5784/java tcp6 0 0 127.0.0.1:55502 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.178:2550 10.30.170.54:49808 ESTABLISHED 5784/java tcp6 0 0 10.30.170.178:57478 10.30.170.54:2550 ESTABLISHED 5784/java tcp6 0 0 127.0.0.1:36166 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.170.178:2550 10.30.170.26:45302 ESTABLISHED 5784/java tcp6 32 0 10.30.170.178:43370 199.204.45.87:443 CLOSE_WAIT 5784/java tcp6 0 0 10.30.170.178:46284 10.30.170.26:2550 ESTABLISHED 5784/java tcp6 0 0 10.30.170.178:2550 10.30.170.26:45298 ESTABLISHED 5784/java tcp6 0 0 10.30.170.178:46278 10.30.170.26:2550 ESTABLISHED 5784/java tcp6 0 0 10.30.170.178:57474 10.30.170.54:2550 ESTABLISHED 5784/java tcp6 0 0 10.30.170.178:2550 10.30.170.54:49814 ESTABLISHED 5784/java tcp6 0 0 127.0.0.1:55486 127.0.0.1:44444 TIME_WAIT - udp 0 0 10.30.170.178:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5784/java looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.170.26' Execute the post startup script on controller 10.30.170.26 + scp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/post-startup-script.sh 10.30.170.26:/tmp/ Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + ssh 10.30.170.26 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-08-18T00:29:42,111 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 299 - org.opendaylight.infrautils.ready-api - 6.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-08-18T00:29:42,111 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 299 - org.opendaylight.infrautils.ready-api - 6.0.9 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.26:22 10.30.170.229:52468 ESTABLISHED - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5786/java tcp6 0 0 :::6653 :::* LISTEN 5786/java tcp6 0 0 :::1790 :::* LISTEN 5786/java tcp6 0 0 :::8101 :::* LISTEN 5786/java tcp6 0 0 :::6633 :::* LISTEN 5786/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5786/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5786/java tcp6 0 0 127.0.0.1:38641 :::* LISTEN 5786/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5786/java tcp6 0 0 10.30.170.26:2550 :::* LISTEN 5786/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:47720 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.170.26:2550 10.30.170.54:49336 ESTABLISHED 5786/java tcp6 0 0 10.30.170.26:2550 10.30.170.178:46284 ESTABLISHED 5786/java tcp6 0 0 10.30.170.26:38770 10.30.170.54:2550 ESTABLISHED 5786/java tcp6 0 0 10.30.170.26:2550 10.30.170.178:46278 ESTABLISHED 5786/java tcp6 0 0 10.30.170.26:38754 10.30.170.54:2550 ESTABLISHED 5786/java tcp6 32 0 10.30.170.26:53564 199.204.45.87:443 CLOSE_WAIT 5786/java tcp6 0 0 10.30.170.26:45298 10.30.170.178:2550 ESTABLISHED 5786/java tcp6 0 0 127.0.0.1:37340 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.26:2550 10.30.170.54:49330 ESTABLISHED 5786/java tcp6 0 0 127.0.0.1:37338 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.26:45302 10.30.170.178:2550 ESTABLISHED 5786/java udp 0 0 10.30.170.26:68 10.30.170.4:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::4342 :::* 5786/java udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.54 'sudo ps aux' Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5748 + echo 'karaf main: org.apache.karaf.main.Main, pid:5748' karaf main: org.apache.karaf.main.Main, pid:5748 + ssh 10.30.170.54 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5748' Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.178 'sudo ps aux' Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5784 + echo 'karaf main: org.apache.karaf.main.Main, pid:5784' karaf main: org.apache.karaf.main.Main, pid:5784 + ssh 10.30.170.178 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5784' Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.26 'sudo ps aux' Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5786 + echo 'karaf main: org.apache.karaf.main.Main, pid:5786' karaf main: org.apache.karaf.main.Main, pid:5786 + ssh 10.30.170.26 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5786' Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.54' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.54 -v ODL_SYSTEM_2_IP:10.30.170.178' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.54 -v ODL_SYSTEM_2_IP:10.30.170.178 -v ODL_SYSTEM_3_IP:10.30.170.26' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell-calcium.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell-calcium.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-calcium: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/testplans/controller-clustering-tell.txt + cat testplan.txt # Place the suites in run order: # disabling all "prefix based" suites. This functionality was newly # introduced with these tests in 2017. The assumption is that # development stopped in that area, but may continue at a later # time. Still, the tests are failing and no resources to solve the # failures at this time. If/When this changes, we can uncomment # those suites. Note that every suite is commented out with it's # accompanying "restart_with_tell_based_true" setup suite. # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_calcium -v BUNDLEFOLDER:karaf-0.20.2-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.20.2-SNAPSHOT/karaf-0.20.2-20240817.204827-277.zip -v CONTROLLER:10.30.170.54 -v CONTROLLER1:10.30.170.178 -v CONTROLLER2:10.30.170.26 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-calcium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:calcium -v ODL_SYSTEM_IP:10.30.170.54 -v ODL_SYSTEM_1_IP:10.30.170.54 -v ODL_SYSTEM_2_IP:10.30.170.178 -v ODL_SYSTEM_3_IP:10.30.170.26 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-tell.txt ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes... ============================================================================== Get_Shard_Role :: Get shard role. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.170.54:8181/restconf/operations/cluster-admin:get-shard-role ------------------------------------------------------------------------------ Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Make_Leader_Local :: Make the loeader local and verify. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Leader :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Follower :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_All_Nodes :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status" Resolving variable '${response.text}' failed: AttributeError: 'ReadTimeout' object has no attribute 'text' ------------------------------------------------------------------------------ controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL | 9 tests, 0 passed, 9 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi... ============================================================================== Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.54', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te... ============================================================================== Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.54', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart2 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.54', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L... ============================================================================== Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.54', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C... ============================================================================== Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) 2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 3) Resolving variable '${response.status_code}' failed: AttributeError: 'No... [ Message content over the limit has been removed. ] 65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 67) TypeError: Expected argument 1 to be a dictionary, got None instead. 68) TypeError: Expected argument 1 to be a dictionary, got None instead. 69) Unrecognized Raft state: None 70) No leader found. 71) Too many Leaders. 72) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.54', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.54', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.54', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.170.54', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart_2 :: Restart odl. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_restart_2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.54', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.178:8181/rests/operations/odl-mdsal-lowlevel-control:register-singleton-constant ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.170.178', port=8181): Max retries exceeded with url: /rests/operations/odl-mdsal-lowlevel-control:unregister-singleton-constant (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic... ============================================================================== Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Persistence Recovery :: This test restar... ============================================================================== Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover :: This test focuses on test... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe... ============================================================================== Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.54:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL | Suite setup failed: HTTPError: 500 Server Error: Internal Server Error for url: http://10.30.170.178:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test... ============================================================================== Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.170.26', port=8181): Read timed out. (read timeout=5.0) 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-tell.txt | FAIL | 162 tests, 11 passed, 151 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/output.xml Log: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/log.html Report: /w/workspace/controller-csit-3node-clustering-tell-all-calcium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.170.54 'ls -altr /tmp/karaf-0.20.2-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. total 104132 drwxrwxr-x. 2 jenkins jenkins 48 Aug 18 00:28 . -rw-rw-r--. 1 jenkins jenkins 1720 Aug 18 00:28 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Aug 18 06:01 .. -rw-rw-r--. 1 jenkins jenkins 80708560 Aug 18 06:15 karaf.log + ssh 10.30.170.54 'du -hs /tmp/karaf-0.20.2-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log 102M /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log + ssh 10.30.170.178 'ls -altr /tmp/karaf-0.20.2-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. total 128452 drwxrwxr-x. 2 jenkins jenkins 48 Aug 18 00:28 . -rw-rw-r--. 1 jenkins jenkins 1720 Aug 18 00:28 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Aug 18 06:01 .. -rw-rw-r--. 1 jenkins jenkins 71926646 Aug 18 06:15 karaf.log + ssh 10.30.170.178 'du -hs /tmp/karaf-0.20.2-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log 126M /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log + ssh 10.30.170.26 'ls -altr /tmp/karaf-0.20.2-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. total 28292 drwxrwxr-x. 2 jenkins jenkins 48 Aug 18 00:28 . -rw-rw-r--. 1 jenkins jenkins 131372 Aug 18 00:37 karaf_console.log drwxrwxr-x. 4 jenkins jenkins 28 Aug 18 06:00 .. -rw-rw-r--. 1 jenkins jenkins 12197712 Aug 18 06:15 karaf.log + ssh 10.30.170.26 'du -hs /tmp/karaf-0.20.2-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. 132K /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log 28M /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.54 'sudo ps aux' Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=31391 + echo 'karaf main: org.apache.karaf.main.Main, pid:31391' karaf main: org.apache.karaf.main.Main, pid:31391 + ssh 10.30.170.54 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 31391' Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.54 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.178 'sudo ps aux' Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_after.log ++ cut -f2 '-d ' ++ grep -v grep ++ tr -s ' ' + pid=39130 + echo 'karaf main: org.apache.karaf.main.Main, pid:39130' karaf main: org.apache.karaf.main.Main, pid:39130 + ssh 10.30.170.178 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 39130' Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.178 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.26 'sudo ps aux' Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-calcium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5786 + echo 'karaf main: org.apache.karaf.main.Main, pid:5786' karaf main: org.apache.karaf.main.Main, pid:5786 + ssh 10.30.170.26 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5786' Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.26 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.170.54 gzip --best /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.170.54:/tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + ssh 10.30.170.54 rm -f /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + scp 10.30.170.54:/tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + ssh 10.30.170.54 rm -f /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.170.54:/tmp/karaf-0.20.2-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.170.54' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.20.2-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.170.178 gzip --best /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. gzip: /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log: file size changed while zipping + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.170.178:/tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + ssh 10.30.170.178 rm -f /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + scp 10.30.170.178:/tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + ssh 10.30.170.178 rm -f /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.170.178:/tmp/karaf-0.20.2-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.170.178' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.20.2-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.170.26 gzip --best /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.170.26:/tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + ssh 10.30.170.26 rm -f /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + scp 10.30.170.26:/tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + ssh 10.30.170.26 rm -f /tmp/karaf-0.20.2-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.170.26:/tmp/karaf-0.20.2-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.170.26' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.20.2-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 72480 drwxrwxr-x. 2 jenkins jenkins 6 Aug 18 06:15 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 131372 Aug 18 06:15 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 409617 Aug 18 06:15 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Aug 18 06:15 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Aug 18 06:15 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 2100922 Aug 18 06:15 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Aug 18 06:15 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Aug 18 06:15 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 2428640 Aug 18 06:15 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 138148 Aug 18 06:15 karaf_3_5786_threads_after.log -rw-rw-r--. 1 jenkins jenkins 16014 Aug 18 06:15 ps_after.log -rw-rw-r--. 1 jenkins jenkins 137615 Aug 18 06:15 karaf_2_39130_threads_after.log -rw-rw-r--. 1 jenkins jenkins 137321 Aug 18 06:15 karaf_1_31391_threads_after.log -rw-rw-r--. 1 jenkins jenkins 306909 Aug 18 06:15 report.html -rw-rw-r--. 1 jenkins jenkins 3506090 Aug 18 06:15 log.html -rw-rw-r--. 1 jenkins jenkins 64316762 Aug 18 06:15 output.xml -rw-rw-r--. 1 jenkins jenkins 6030 Aug 18 00:29 testplan.txt -rw-rw-r--. 1 jenkins jenkins 157157 Aug 18 00:29 karaf_3_5786_threads_before.log -rw-rw-r--. 1 jenkins jenkins 16830 Aug 18 00:29 ps_before.log -rw-rw-r--. 1 jenkins jenkins 159098 Aug 18 00:29 karaf_2_5784_threads_before.log -rw-rw-r--. 1 jenkins jenkins 157744 Aug 18 00:29 karaf_1_5748_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Aug 18 00:28 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Aug 18 00:28 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3453 Aug 18 00:28 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Aug 18 00:28 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 135 Aug 18 00:28 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 337 Aug 18 00:28 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2619 Aug 18 00:28 pom.xml -rw-rw-r--. 1 jenkins jenkins 86 Aug 18 00:28 set_variables.env -rw-rw-r--. 1 jenkins jenkins 311 Aug 18 00:28 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Aug 18 00:27 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Aug 18 00:27 env.properties -rw-rw-r--. 1 jenkins jenkins 335 Aug 18 00:25 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Aug 18 00:24 test drwxrwxr-x. 2 jenkins jenkins 6 Aug 18 00:24 test@tmp -rw-rw-r--. 1 jenkins jenkins 1410 Aug 17 20:48 maven-metadata.xml + true [controller-csit-3node-clustering-tell-all-calcium] $ /bin/sh /tmp/jenkins15967998885669729225.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5289 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins8683929884517190994.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 4544k 0 4544k 0 0 4298k 0 --:--:-- 0:00:01 --:--:-- 4294k 100 5059k 0 5059k 0 0 4426k 0 --:--:-- 0:00:01 --:--:-- 4422k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins17323546853879152906.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-calcium-49 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins657107730505120709.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-tell-all-calcium-49 DEBUG: Successfully retrieved stack cost: total: 1.98 INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-calcium-49 Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-calcium-49 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins4696460802539233087.sh ---> sysstat.sh [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins14107678428693009274.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-calcium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-calcium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-calcium ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-calcium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-calcium/archives/ [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins11408031930745635689.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins11845317766586656162.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-calcium #49 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-calcium@tmp/config17920137401531948475tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins12645962807668194520.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins9344834236966656319.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins10163418792251224866.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash /tmp/jenkins9262288343453816941.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH DEBUG: total: 1.98 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-tell-all-calcium] $ /bin/bash -l /tmp/jenkins12133429031320684330.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-calcium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-bp6v from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-bp6v/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-calcium/49/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-11625.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.4G 32G 21% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 644 4771 19 2281 6756 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:97:1c:5a brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.229/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 65180sec preferred_lft 65180sec inet6 fe80::f816:3eff:fe97:1c5a/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 08/18/2024 _x86_64_ (2 CPU) 00:23:15 LINUX RESTART (2 CPU) 12:24:01 AM tps rtps wtps bread/s bwrtn/s 12:25:01 AM 92.70 52.16 40.54 7315.45 17484.72 12:26:01 AM 119.79 3.60 116.19 74.24 10254.40 12:27:01 AM 27.71 1.23 26.47 152.35 2700.35 12:28:01 AM 23.91 0.03 23.88 2.27 1542.14 12:29:01 AM 48.75 2.52 46.23 396.00 6969.49 12:30:01 AM 3.05 0.08 2.97 31.99 85.02 12:31:01 AM 1.98 0.00 1.98 0.00 96.07 12:32:01 AM 0.42 0.00 0.42 0.00 20.75 12:33:01 AM 0.28 0.00 0.28 0.00 17.23 12:34:01 AM 0.40 0.00 0.40 0.00 17.98 12:35:01 AM 0.48 0.00 0.48 0.00 15.61 12:36:01 AM 0.57 0.00 0.57 0.00 17.34 12:37:01 AM 0.43 0.03 0.40 1.87 24.43 12:38:01 AM 0.47 0.00 0.47 0.00 9.11 12:39:01 AM 0.47 0.03 0.43 0.27 5.88 12:40:01 AM 1.35 0.03 1.32 1.33 31.74 12:41:01 AM 0.20 0.00 0.20 0.00 4.60 12:42:01 AM 0.22 0.00 0.22 0.00 3.22 12:43:01 AM 0.18 0.00 0.18 0.00 4.70 12:44:01 AM 0.47 0.00 0.47 0.00 7.43 12:45:01 AM 0.18 0.00 0.18 0.00 7.65 12:46:01 AM 0.20 0.00 0.20 0.00 7.25 12:47:01 AM 0.18 0.00 0.18 0.00 4.15 12:48:01 AM 0.15 0.00 0.15 0.00 1.48 12:49:01 AM 0.35 0.00 0.35 0.00 5.41 12:50:01 AM 0.22 0.00 0.22 0.00 6.18 12:51:01 AM 0.27 0.00 0.27 0.00 3.35 12:52:01 AM 0.23 0.00 0.23 0.00 4.83 12:53:01 AM 0.13 0.00 0.13 0.00 4.25 12:54:01 AM 0.28 0.00 0.28 0.00 4.48 12:55:01 AM 0.18 0.00 0.18 0.00 3.68 12:56:01 AM 0.17 0.00 0.17 0.00 4.13 12:57:01 AM 0.12 0.00 0.12 0.00 0.92 12:58:01 AM 0.13 0.00 0.13 0.00 5.08 12:59:01 AM 0.35 0.00 0.35 0.00 5.40 01:00:01 AM 0.15 0.00 0.15 0.00 1.78 01:01:01 AM 0.25 0.05 0.20 0.40 5.78 01:02:01 AM 0.57 0.07 0.50 1.73 8.51 01:03:01 AM 0.20 0.00 0.20 0.00 5.08 01:04:01 AM 0.23 0.00 0.23 0.00 4.35 01:05:01 AM 0.27 0.00 0.27 0.00 4.97 01:06:01 AM 5.98 5.75 0.23 555.55 4.85 01:07:01 AM 2.98 0.00 2.98 0.00 70.79 01:08:01 AM 0.22 0.00 0.22 0.00 3.98 01:09:01 AM 0.18 0.00 0.18 0.00 1.52 01:10:01 AM 0.32 0.00 0.32 0.00 4.72 01:11:01 AM 0.32 0.00 0.32 0.00 4.27 01:12:01 AM 0.60 0.32 0.28 6.93 4.02 01:13:01 AM 0.70 0.00 0.70 0.00 17.61 01:14:01 AM 0.40 0.02 0.38 0.13 10.21 01:15:01 AM 0.35 0.00 0.35 0.00 15.14 01:16:01 AM 0.17 0.00 0.17 0.00 14.65 01:17:01 AM 0.13 0.00 0.13 0.00 14.00 01:18:01 AM 0.12 0.00 0.12 0.00 8.27 01:19:01 AM 0.20 0.00 0.20 0.00 14.71 01:20:01 AM 0.30 0.00 0.30 0.00 20.33 01:21:01 AM 0.30 0.00 0.30 0.00 19.91 01:22:01 AM 0.23 0.00 0.23 0.00 7.33 01:23:01 AM 0.12 0.00 0.12 0.00 1.18 01:24:01 AM 0.17 0.00 0.17 0.00 3.92 01:25:01 AM 0.22 0.00 0.22 0.00 4.05 01:26:01 AM 0.12 0.00 0.12 0.00 0.92 01:27:01 AM 0.18 0.00 0.18 0.00 4.15 01:28:01 AM 0.10 0.00 0.10 0.00 0.77 01:29:01 AM 0.18 0.00 0.18 0.00 9.11 01:30:01 AM 0.25 0.00 0.25 0.00 5.77 01:31:01 AM 0.28 0.00 0.28 0.00 3.50 01:32:01 AM 0.27 0.00 0.27 0.00 4.57 01:33:01 AM 0.50 0.00 0.50 0.00 7.60 01:34:01 AM 0.22 0.00 0.22 0.00 4.08 01:35:01 AM 0.23 0.00 0.23 0.00 12.06 01:36:01 AM 0.25 0.00 0.25 0.00 14.66 01:37:01 AM 0.18 0.00 0.18 0.00 14.15 01:38:01 AM 0.17 0.00 0.17 0.00 11.05 01:39:01 AM 0.18 0.00 0.18 0.00 15.11 01:40:01 AM 0.25 0.00 0.25 0.00 13.10 01:41:01 AM 0.20 0.00 0.20 0.00 10.85 01:42:01 AM 0.18 0.00 0.18 0.00 3.63 01:43:01 AM 0.23 0.00 0.23 0.00 2.57 01:44:01 AM 0.40 0.00 0.40 0.00 13.48 01:45:01 AM 0.18 0.00 0.18 0.00 12.70 01:46:01 AM 0.15 0.00 0.15 0.00 8.65 01:47:01 AM 0.13 0.00 0.13 0.00 14.66 01:48:01 AM 0.13 0.00 0.13 0.00 12.53 01:49:01 AM 0.35 0.00 0.35 0.00 19.14 01:50:01 AM 0.12 0.00 0.12 0.00 8.13 01:51:01 AM 0.32 0.00 0.32 0.00 26.54 01:52:01 AM 0.43 0.00 0.43 0.00 8.28 01:53:01 AM 0.47 0.00 0.47 0.00 6.53 01:54:01 AM 0.52 0.00 0.52 0.00 8.78 01:55:01 AM 0.35 0.00 0.35 0.00 3.85 01:56:01 AM 0.35 0.00 0.35 0.00 6.10 01:57:01 AM 0.43 0.00 0.43 0.00 5.93 01:58:01 AM 0.33 0.00 0.33 0.00 6.01 01:59:01 AM 0.60 0.00 0.60 0.00 12.38 02:00:01 AM 0.32 0.00 0.32 0.00 5.33 02:01:01 AM 0.17 0.00 0.17 0.00 1.77 02:02:01 AM 0.25 0.00 0.25 0.00 3.85 02:03:01 AM 0.18 0.00 0.18 0.00 12.41 02:04:01 AM 0.42 0.00 0.42 0.00 18.81 02:05:01 AM 0.28 0.00 0.28 0.00 15.41 02:06:01 AM 0.27 0.00 0.27 0.00 11.51 02:07:01 AM 0.13 0.00 0.13 0.00 14.93 02:08:01 AM 0.15 0.00 0.15 0.00 7.23 02:09:01 AM 0.40 0.00 0.40 0.00 18.93 02:10:01 AM 0.48 0.00 0.48 0.00 9.77 02:11:01 AM 0.23 0.00 0.23 0.00 8.76 02:12:01 AM 0.22 0.00 0.22 0.00 16.14 02:13:01 AM 0.18 0.00 0.18 0.00 16.40 02:14:01 AM 0.20 0.00 0.20 0.00 15.60 02:15:01 AM 0.27 0.00 0.27 0.00 12.98 02:16:01 AM 0.17 0.00 0.17 0.00 13.33 02:17:01 AM 0.28 0.00 0.28 0.00 10.10 02:18:01 AM 0.22 0.00 0.22 0.00 11.23 02:19:01 AM 0.17 0.00 0.17 0.00 10.45 02:20:01 AM 0.25 0.00 0.25 0.00 16.96 02:21:01 AM 0.23 0.00 0.23 0.00 16.93 02:22:01 AM 0.23 0.00 0.23 0.00 16.08 02:23:01 AM 0.20 0.00 0.20 0.00 10.03 02:24:02 AM 0.33 0.00 0.33 0.00 16.36 02:25:01 AM 0.36 0.00 0.36 0.00 27.32 02:26:01 AM 0.35 0.00 0.35 0.00 3.77 02:27:01 AM 0.23 0.00 0.23 0.00 3.48 02:28:01 AM 0.12 0.00 0.12 0.00 3.35 02:29:01 AM 0.20 0.00 0.20 0.00 1.90 02:30:01 AM 0.25 0.00 0.25 0.00 6.15 02:31:01 AM 0.30 0.00 0.30 0.00 3.78 02:32:01 AM 0.18 0.00 0.18 0.00 3.07 02:33:01 AM 0.15 0.00 0.15 0.00 8.93 02:34:01 AM 0.22 0.00 0.22 0.00 4.60 02:35:01 AM 0.22 0.00 0.22 0.00 3.40 02:36:01 AM 0.18 0.00 0.18 0.00 3.48 02:37:01 AM 0.13 0.00 0.13 0.00 16.39 02:38:01 AM 0.12 0.00 0.12 0.00 7.86 02:39:01 AM 0.20 0.00 0.20 0.00 15.64 02:40:01 AM 0.30 0.00 0.30 0.00 15.36 02:41:01 AM 0.47 0.00 0.47 0.00 20.53 02:42:01 AM 0.33 0.00 0.33 0.00 15.41 02:43:01 AM 0.25 0.00 0.25 0.00 4.93 02:44:01 AM 0.28 0.00 0.28 0.00 10.46 02:45:01 AM 0.22 0.00 0.22 0.00 14.71 02:46:01 AM 0.18 0.00 0.18 0.00 15.35 02:47:01 AM 0.12 0.00 0.12 0.00 6.81 02:48:01 AM 0.35 0.00 0.35 0.00 21.45 02:49:01 AM 0.20 0.00 0.20 0.00 13.66 02:50:01 AM 0.32 0.00 0.32 0.00 15.08 02:51:01 AM 0.33 0.00 0.33 0.00 22.44 02:52:01 AM 0.40 0.00 0.40 0.00 7.78 02:53:01 AM 0.30 0.00 0.30 0.00 3.02 02:54:01 AM 0.35 0.00 0.35 0.00 6.41 02:55:01 AM 0.62 0.00 0.62 0.00 9.12 02:56:01 AM 0.35 0.00 0.35 0.00 5.75 02:57:01 AM 0.33 0.00 0.33 0.00 3.70 02:58:01 AM 0.32 0.00 0.32 0.00 9.17 02:59:01 AM 0.57 0.00 0.57 0.00 9.13 03:00:01 AM 0.87 0.00 0.87 0.00 13.73 03:01:01 AM 0.58 0.00 0.58 0.00 8.43 03:02:01 AM 0.33 0.00 0.33 0.00 5.75 03:03:01 AM 0.18 0.00 0.18 0.00 2.63 03:04:01 AM 0.30 0.00 0.30 0.00 7.55 03:05:01 AM 0.23 0.00 0.23 0.00 3.05 03:06:01 AM 0.18 0.00 0.18 0.00 4.40 03:07:01 AM 0.10 0.00 0.10 0.00 0.68 03:08:01 AM 0.15 0.00 0.15 0.00 1.47 03:09:01 AM 0.38 0.00 0.38 0.00 8.63 03:10:01 AM 0.10 0.00 0.10 0.00 1.05 03:11:01 AM 0.18 0.00 0.18 0.00 4.85 03:12:01 AM 0.27 0.00 0.27 0.00 3.60 03:13:01 AM 0.20 0.00 0.20 0.00 4.80 03:14:01 AM 0.33 0.00 0.33 0.00 5.88 03:15:01 AM 0.20 0.00 0.20 0.00 4.58 03:16:01 AM 0.30 0.00 0.30 0.00 21.33 03:17:01 AM 0.50 0.00 0.50 0.00 17.31 03:18:01 AM 0.50 0.00 0.50 0.00 16.51 03:19:01 AM 0.63 0.00 0.63 0.00 17.58 03:20:01 AM 0.23 0.00 0.23 0.00 9.88 03:21:01 AM 0.30 0.00 0.30 0.00 17.51 03:22:01 AM 0.23 0.00 0.23 0.00 4.97 03:23:01 AM 0.15 0.00 0.15 0.00 4.78 03:24:01 AM 0.28 0.00 0.28 0.00 4.88 03:25:01 AM 0.13 0.00 0.13 0.00 4.28 03:26:01 AM 0.13 0.00 0.13 0.00 1.97 03:27:01 AM 0.20 0.00 0.20 0.00 5.35 03:28:01 AM 0.18 0.00 0.18 0.00 2.50 03:29:01 AM 0.35 0.00 0.35 0.00 8.38 03:30:01 AM 0.30 0.00 0.30 0.00 4.45 03:31:01 AM 0.23 0.00 0.23 0.00 5.58 03:32:02 AM 0.22 0.00 0.22 0.00 3.62 03:33:01 AM 0.25 0.00 0.25 0.00 6.27 03:34:01 AM 0.20 0.00 0.20 0.00 2.08 03:35:01 AM 0.20 0.00 0.20 0.00 6.95 03:36:01 AM 0.28 0.00 0.28 0.00 12.03 03:37:01 AM 0.20 0.00 0.20 0.00 15.91 03:38:01 AM 0.15 0.00 0.15 0.00 15.20 03:39:01 AM 0.22 0.00 0.22 0.00 10.45 03:40:01 AM 0.25 0.00 0.25 0.00 15.76 03:41:01 AM 0.20 0.00 0.20 0.00 15.79 03:42:01 AM 0.17 0.00 0.17 0.00 7.10 03:43:01 AM 0.25 0.00 0.25 0.00 6.01 03:44:01 AM 0.27 0.00 0.27 0.00 3.30 03:45:01 AM 0.22 0.00 0.22 0.00 6.45 03:46:01 AM 0.17 0.00 0.17 0.00 1.72 03:47:01 AM 0.12 0.00 0.12 0.00 3.87 03:48:01 AM 0.12 0.00 0.12 0.00 1.30 03:49:01 AM 0.17 0.00 0.17 0.00 4.32 03:50:01 AM 0.28 0.00 0.28 0.00 3.92 03:51:01 AM 0.37 0.00 0.37 0.00 7.70 03:52:01 AM 0.28 0.00 0.28 0.00 4.15 03:53:01 AM 0.13 0.00 0.13 0.00 4.57 03:54:01 AM 0.20 0.00 0.20 0.00 1.93 03:55:01 AM 0.22 0.00 0.22 0.00 7.08 03:56:01 AM 0.13 0.00 0.13 0.00 9.33 03:57:01 AM 0.13 0.00 0.13 0.00 14.66 03:58:01 AM 0.12 0.00 0.12 0.00 13.60 03:59:01 AM 0.18 0.00 0.18 0.00 16.20 04:00:01 AM 0.33 0.00 0.33 0.00 12.16 04:01:01 AM 0.27 0.00 0.27 0.00 17.38 04:02:01 AM 0.17 0.00 0.17 0.00 9.73 04:03:01 AM 0.12 0.00 0.12 0.00 1.22 04:04:01 AM 0.28 0.00 0.28 0.00 2.98 04:05:01 AM 0.27 0.00 0.27 0.00 7.27 04:06:01 AM 0.17 0.00 0.17 0.00 1.72 04:07:01 AM 0.12 0.00 0.12 0.00 3.87 04:08:01 AM 0.12 0.00 0.12 0.00 1.33 04:09:01 AM 0.43 0.00 0.43 0.00 9.30 04:10:01 AM 0.17 0.00 0.17 0.00 2.48 04:11:01 AM 0.27 0.00 0.27 0.00 6.15 04:12:01 AM 0.20 0.00 0.20 0.00 3.25 04:13:01 AM 0.18 0.00 0.18 0.00 4.58 04:14:01 AM 0.33 0.00 0.33 0.00 5.68 04:15:01 AM 0.13 0.00 0.13 0.00 8.93 04:16:01 AM 0.20 0.00 0.20 0.00 13.25 04:17:01 AM 0.12 0.00 0.12 0.00 7.73 04:18:01 AM 0.20 0.00 0.20 0.00 18.39 04:19:01 AM 0.37 0.00 0.37 0.00 13.83 04:20:01 AM 0.15 0.00 0.15 0.00 14.26 04:21:01 AM 0.40 0.00 0.40 0.00 16.51 04:22:01 AM 0.13 0.00 0.13 0.00 21.86 04:23:01 AM 0.13 0.00 0.13 0.00 2.93 04:24:01 AM 0.35 0.00 0.35 0.00 8.28 04:25:01 AM 0.17 0.00 0.17 0.00 1.33 04:26:01 AM 1.12 0.00 1.12 0.00 20.76 04:27:01 AM 0.20 0.00 0.20 0.00 3.18 04:28:01 AM 0.12 0.00 0.12 0.00 3.20 04:29:01 AM 0.35 0.00 0.35 0.00 5.17 04:30:01 AM 0.22 0.00 0.22 0.00 8.80 04:31:01 AM 0.28 0.00 0.28 0.00 4.36 04:32:01 AM 0.17 0.00 0.17 0.00 5.31 04:33:02 AM 0.12 0.00 0.12 0.00 0.77 04:34:01 AM 0.39 0.00 0.39 0.00 11.38 04:35:01 AM 0.23 0.00 0.23 0.00 15.49 04:36:01 AM 0.32 0.00 0.32 0.00 14.13 04:37:01 AM 0.20 0.00 0.20 0.00 11.75 04:38:01 AM 0.28 0.00 0.28 0.00 18.13 04:39:01 AM 0.23 0.00 0.23 0.00 12.18 04:40:01 AM 0.30 0.00 0.30 0.00 17.48 04:41:01 AM 0.17 0.00 0.17 0.00 4.18 04:42:01 AM 0.23 0.00 0.23 0.00 12.26 04:43:01 AM 0.18 0.00 0.18 0.00 15.18 04:44:01 AM 0.33 0.00 0.33 0.00 12.03 04:45:01 AM 0.28 0.00 0.28 0.00 16.88 04:46:01 AM 0.22 0.00 0.22 0.00 17.93 04:47:01 AM 0.53 0.00 0.53 0.00 15.41 04:48:01 AM 0.43 0.00 0.43 0.00 14.11 04:49:01 AM 0.30 0.00 0.30 0.00 11.10 04:50:01 AM 0.25 0.00 0.25 0.00 8.30 04:51:01 AM 0.28 0.00 0.28 0.00 16.29 04:52:01 AM 0.23 0.00 0.23 0.00 15.74 04:53:01 AM 0.13 0.00 0.13 0.00 14.80 04:54:01 AM 0.23 0.00 0.23 0.00 11.40 04:55:01 AM 0.27 0.00 0.27 0.00 16.50 04:56:01 AM 0.18 0.00 0.18 0.00 23.61 04:57:01 AM 0.12 0.00 0.12 0.00 4.13 04:58:01 AM 0.15 0.00 0.15 0.00 1.48 04:59:01 AM 0.18 0.00 0.18 0.00 4.58 05:00:01 AM 0.37 0.00 0.37 0.00 5.68 05:01:01 AM 0.30 0.00 0.30 0.00 3.62 05:02:01 AM 0.20 0.00 0.20 0.00 5.08 05:03:01 AM 0.15 0.00 0.15 0.00 1.48 05:04:01 AM 0.18 0.00 0.18 0.00 7.70 05:05:01 AM 0.35 0.00 0.35 0.00 12.06 05:06:01 AM 0.40 0.00 0.40 0.00 5.18 05:07:01 AM 0.28 0.00 0.28 0.00 4.27 05:08:01 AM 0.12 0.00 0.12 0.00 2.67 05:09:01 AM 0.23 0.00 0.23 0.00 5.68 05:10:01 AM 0.27 0.00 0.27 0.00 5.70 05:11:01 AM 0.23 0.00 0.23 0.00 7.38 05:12:01 AM 0.23 0.00 0.23 0.00 3.43 05:13:01 AM 0.17 0.00 0.17 0.00 6.02 05:14:01 AM 0.18 0.00 0.18 0.00 13.40 05:15:01 AM 0.22 0.00 0.22 0.00 10.43 05:16:01 AM 0.15 0.00 0.15 0.00 14.66 05:17:01 AM 0.15 0.00 0.15 0.00 14.30 05:18:01 AM 0.13 0.00 0.13 0.00 14.66 05:19:01 AM 0.18 0.00 0.18 0.00 8.18 05:20:01 AM 0.25 0.00 0.25 0.00 26.17 05:21:01 AM 0.33 0.00 0.33 0.00 13.93 05:22:01 AM 0.23 0.00 0.23 0.00 9.23 05:23:01 AM 0.12 0.00 0.12 0.00 7.07 05:24:01 AM 0.33 0.00 0.33 0.00 17.01 05:25:01 AM 0.18 0.00 0.18 0.00 15.19 05:26:01 AM 0.25 0.00 0.25 0.00 12.58 05:27:01 AM 0.12 0.00 0.12 0.00 2.82 05:28:01 AM 0.32 0.00 0.32 0.00 9.88 05:29:01 AM 0.65 0.00 0.65 0.00 10.86 05:30:01 AM 0.35 0.00 0.35 0.00 7.85 05:31:01 AM 0.43 0.00 0.43 0.00 13.50 05:32:01 AM 0.38 0.00 0.38 0.00 9.26 05:33:01 AM 0.18 0.00 0.18 0.00 16.13 05:34:01 AM 0.33 0.00 0.33 0.00 12.93 05:35:01 AM 0.30 0.00 0.30 0.00 19.13 05:36:01 AM 0.25 0.00 0.25 0.00 9.36 05:37:01 AM 0.27 0.00 0.27 0.00 20.03 05:38:01 AM 0.10 0.00 0.10 0.00 7.47 05:39:01 AM 0.35 0.00 0.35 0.00 24.61 05:40:01 AM 0.12 0.00 0.12 0.00 1.57 05:41:02 AM 0.15 0.00 0.15 0.00 1.37 05:42:01 AM 0.20 0.00 0.20 0.00 5.42 05:43:01 AM 0.20 0.00 0.20 0.00 2.52 05:44:01 AM 0.37 0.00 0.37 0.00 8.76 05:45:01 AM 0.13 0.00 0.13 0.00 1.47 05:46:01 AM 0.22 0.00 0.22 0.00 8.08 05:47:01 AM 0.17 0.00 0.17 0.00 7.50 05:48:01 AM 0.28 0.00 0.28 0.00 3.70 05:49:01 AM 1.03 0.00 1.03 0.00 15.58 05:50:01 AM 0.37 0.00 0.37 0.00 7.07 05:51:01 AM 0.22 0.00 0.22 0.00 3.08 05:52:01 AM 0.22 0.00 0.22 0.00 9.25 05:53:01 AM 0.22 0.00 0.22 0.00 3.60 05:54:01 AM 0.22 0.00 0.22 0.00 7.48 05:55:01 AM 0.30 0.00 0.30 0.00 12.76 05:56:01 AM 0.32 0.00 0.32 0.00 16.71 05:57:01 AM 0.27 0.00 0.27 0.00 9.85 05:58:01 AM 0.18 0.00 0.18 0.00 16.25 05:59:01 AM 0.23 0.00 0.23 0.00 16.74 06:00:01 AM 0.30 0.00 0.30 0.00 9.95 06:01:01 AM 0.18 0.00 0.18 0.00 23.23 06:02:01 AM 0.30 0.00 0.30 0.00 12.43 06:03:01 AM 0.17 0.00 0.17 0.00 2.00 06:04:01 AM 0.17 0.00 0.17 0.00 4.03 06:05:01 AM 0.23 0.00 0.23 0.00 4.05 06:06:01 AM 0.12 0.00 0.12 0.00 0.77 06:07:01 AM 0.15 0.00 0.15 0.00 3.92 06:08:01 AM 0.17 0.00 0.17 0.00 1.98 06:09:01 AM 0.30 0.00 0.30 0.00 9.85 06:10:01 AM 0.58 0.00 0.58 0.00 17.43 06:11:01 AM 0.45 0.00 0.45 0.00 13.63 06:12:01 AM 0.27 0.00 0.27 0.00 14.01 06:13:01 AM 0.17 0.00 0.17 0.00 9.75 06:14:01 AM 0.17 0.00 0.17 0.00 7.40 06:15:01 AM 0.23 0.00 0.23 0.00 15.70 06:16:01 AM 10.48 0.32 10.16 36.92 469.56 Average: 1.22 0.19 1.03 24.37 121.82 12:24:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:25:01 AM 5375460 7006400 2506972 31.80 2688 1820844 787784 8.82 217004 1999140 123120 12:26:01 AM 5191684 7013724 2690748 34.14 2688 1998940 707616 7.92 212452 2120452 39044 12:27:01 AM 5249476 7076864 2632956 33.40 2688 2004664 665836 7.46 241340 2049112 12 12:28:01 AM 5017156 7040584 2865276 36.35 2688 2192748 691364 7.74 258680 2239904 170480 12:29:01 AM 5005812 7044496 2876620 36.49 2688 2207956 661140 7.40 264880 2239072 28 12:30:01 AM 4963100 7003360 2919332 37.04 2688 2209516 728176 8.15 265020 2280996 592 12:31:01 AM 4960276 7001036 2922156 37.07 2688 2209996 746464 8.36 265020 2284036 200 12:32:01 AM 4959264 7000368 2923168 37.08 2688 2210340 746464 8.36 265020 2285184 112 12:33:01 AM 4955472 6996928 2926960 37.13 2688 2210692 746464 8.36 265020 2289032 48 12:34:01 AM 4954592 6996360 2927840 37.14 2688 2211012 746464 8.36 265020 2289964 4 12:35:01 AM 4953560 6995688 2928872 37.16 2688 2211364 746464 8.36 265020 2290976 32 12:36:01 AM 4952128 6994608 2930304 37.18 2688 2211724 746464 8.36 265020 2292536 24 12:37:01 AM 4952476 6995624 2929956 37.17 2688 2212384 746464 8.36 265660 2292020 8 12:38:01 AM 4952400 6995632 2930032 37.17 2688 2212484 746464 8.36 265660 2292192 4 12:39:01 AM 4952116 6995348 2930316 37.18 2688 2212488 739412 8.28 265736 2292320 20 12:40:01 AM 4951372 6994724 2931060 37.18 2688 2212604 757004 8.48 265740 2293176 84 12:41:01 AM 4951188 6994552 2931244 37.19 2688 2212608 757004 8.48 265740 2292976 16 12:42:01 AM 4951636 6995072 2930796 37.18 2688 2212680 757004 8.48 265740 2292612 84 12:43:01 AM 4951792 6995232 2930640 37.18 2688 2212684 757004 8.48 265740 2292656 4 12:44:01 AM 4951780 6995220 2930652 37.18 2688 2212684 741256 8.30 265740 2292592 4 12:45:01 AM 4951628 6995252 2930804 37.18 2688 2212868 741256 8.30 265888 2292648 28 12:46:01 AM 4951680 6995444 2930752 37.18 2688 2213008 741256 8.30 265892 2292624 8 12:47:01 AM 4951616 6995448 2930816 37.18 2688 2213076 741256 8.30 265888 2292664 4 12:48:01 AM 4951508 6995340 2930924 37.18 2688 2213076 741256 8.30 265888 2292992 12 12:49:01 AM 4951568 6995460 2930864 37.18 2688 2213144 741256 8.30 265892 2292808 80 12:50:01 AM 4950408 6994364 2932024 37.20 2688 2213200 741084 8.30 265888 2293816 4 12:51:01 AM 4951036 6994996 2931396 37.19 2688 2213204 741084 8.30 265888 2293272 4 12:52:01 AM 4951116 6995196 2931316 37.19 2688 2213324 741084 8.30 265892 2293272 76 12:53:01 AM 4950704 6994784 2931728 37.19 2688 2213324 741084 8.30 265888 2293584 4 12:54:01 AM 4950760 6994884 2931672 37.19 2688 2213368 741084 8.30 265888 2293436 52 12:55:01 AM 4950696 6994896 2931736 37.19 2688 2213444 741084 8.30 265888 2293572 72 12:56:01 AM 4950168 6994368 2932264 37.20 2688 2213444 756460 8.47 265888 2293808 4 12:57:01 AM 4950748 6994996 2931684 37.19 2688 2213492 756460 8.47 265888 2293516 56 12:58:01 AM 4950668 6994992 2931764 37.19 2688 2213568 756460 8.47 265888 2293596 4 12:59:01 AM 4950600 6994924 2931832 37.19 2688 2213568 756460 8.47 265888 2293596 4 01:00:01 AM 4949176 6993556 2933256 37.21 2688 2213632 756460 8.47 265888 2294588 72 01:01:01 AM 4949028 6993492 2933404 37.21 2688 2213704 756460 8.47 265892 2294580 8 01:02:01 AM 4949808 6994344 2932624 37.20 2688 2213776 756460 8.47 266004 2293992 4 01:03:01 AM 4949832 6994488 2932600 37.20 2688 2213896 756460 8.47 266004 2294228 60 01:04:01 AM 4949732 6994388 2932700 37.21 2688 2213896 756460 8.47 266008 2294224 4 01:05:01 AM 4949504 6994208 2932928 37.21 2688 2213944 756460 8.47 266008 2294476 56 01:06:01 AM 4932688 6994128 2949744 37.42 2688 2230628 758576 8.49 268392 2308748 676 01:07:01 AM 4932132 6993576 2950300 37.43 2688 2230628 758576 8.49 268392 2309008 16 01:08:01 AM 4932584 6994028 2949848 37.42 2688 2230628 758576 8.49 268392 2308744 8 01:09:01 AM 4932520 6993968 2949912 37.42 2688 2230632 758576 8.49 268392 2308924 16 01:10:01 AM 4932152 6993600 2950280 37.43 2688 2230632 758364 8.49 268392 2309092 4 01:11:01 AM 4932620 6994080 2949812 37.42 2688 2230636 758364 8.49 268392 2308852 4 01:12:01 AM 4932480 6994132 2949952 37.42 2688 2230828 758364 8.49 268496 2308856 8 01:13:01 AM 4932468 6994124 2949964 37.42 2688 2230832 758364 8.49 268536 2308808 4 01:14:01 AM 4932132 6993972 2950300 37.43 2688 2231016 758364 8.49 268536 2308996 24 01:15:01 AM 4931836 6994072 2950596 37.43 2688 2231412 758364 8.49 268536 2309356 120 01:16:01 AM 4931520 6994112 2950912 37.44 2688 2231764 758364 8.49 268536 2309652 80 01:17:01 AM 4931232 6994168 2951200 37.44 2688 2232116 758364 8.49 268536 2310100 40 01:18:01 AM 4930812 6994116 2951620 37.45 2688 2232476 758364 8.49 268536 2310448 184 01:19:01 AM 4930244 6993884 2952188 37.45 2688 2232812 758364 8.49 268536 2311168 136 01:20:01 AM 4928144 6992144 2954288 37.48 2688 2233172 780316 8.74 268536 2312836 4 01:21:01 AM 4927844 6992392 2954588 37.48 2688 2233724 760852 8.52 268536 2313276 56 01:22:01 AM 4927748 6992376 2954684 37.48 2688 2233796 760852 8.52 268536 2313360 4 01:23:01 AM 4927832 6992460 2954600 37.48 2688 2233796 760852 8.52 268536 2313360 4 01:24:01 AM 4928088 6992796 2954344 37.48 2688 2233876 760852 8.52 268536 2313244 4 01:25:01 AM 4927840 6992552 2954592 37.48 2688 2233880 760852 8.52 268536 2313432 4 01:26:01 AM 4927800 6992580 2954632 37.48 2688 2233948 760852 8.52 268536 2313640 76 01:27:01 AM 4928028 6992808 2954404 37.48 2688 2233948 760852 8.52 268536 2313320 4 01:28:01 AM 4927820 6992780 2954612 37.48 2688 2234128 743524 8.33 268536 2313536 184 01:29:01 AM 4926996 6992004 2955436 37.49 2688 2234176 743524 8.33 268536 2314088 16 01:30:01 AM 4926772 6991844 2955660 37.50 2688 2234240 765008 8.57 268536 2314096 8 01:31:01 AM 4927132 6992200 2955300 37.49 2688 2234244 742988 8.32 268536 2313896 4 01:32:01 AM 4926948 6992040 2955484 37.49 2688 2234268 742988 8.32 268536 2314240 8 01:33:01 AM 4927184 6992288 2955248 37.49 2688 2234280 742988 8.32 268564 2314012 16 01:34:01 AM 4927440 6992596 2954992 37.49 2688 2234332 742988 8.32 268564 2313872 4 01:35:01 AM 4926928 6992436 2955504 37.49 2688 2234684 760692 8.52 268564 2314300 100 01:36:01 AM 4926752 6992600 2955680 37.50 2688 2235024 760692 8.52 268564 2314568 80 01:37:01 AM 4926156 6992320 2956276 37.50 2688 2235340 760692 8.52 268564 2314892 24 01:38:01 AM 4926032 6992548 2956400 37.51 2688 2235692 760692 8.52 268564 2315124 104 01:39:01 AM 4925624 6992464 2956808 37.51 2688 2236024 760692 8.52 268564 2315448 24 01:40:01 AM 4924560 6991784 2957872 37.52 2688 2236396 751248 8.41 268564 2316492 120 01:41:01 AM 4924952 6992348 2957480 37.52 2688 2236564 751248 8.41 268676 2316260 4 01:42:01 AM 4924980 6992420 2957452 37.52 2688 2236608 751248 8.41 268676 2316108 4 01:43:01 AM 4924716 6992164 2957716 37.52 2688 2236616 751248 8.41 268676 2316472 28 01:44:01 AM 4924308 6991960 2958124 37.53 2688 2236820 751248 8.41 268676 2316820 20 01:45:01 AM 4922668 6990656 2959764 37.55 2688 2237152 751248 8.41 268676 2318484 4 01:46:01 AM 4921844 6990172 2960588 37.56 2688 2237508 751248 8.41 268676 2319180 148 01:47:01 AM 4921380 6990068 2961052 37.57 2688 2237860 751248 8.41 268676 2319584 88 01:48:01 AM 4921152 6990172 2961280 37.57 2688 2238200 751248 8.41 268676 2319976 80 01:49:01 AM 4920660 6990020 2961772 37.57 2688 2238532 751248 8.41 268676 2320368 88 01:50:01 AM 4918564 6988260 2963868 37.60 2688 2238868 746512 8.36 268676 2322472 120 01:51:01 AM 4918676 6988960 2963756 37.60 2688 2239456 746512 8.36 268676 2322320 4 01:52:01 AM 4918768 6989140 2963664 37.60 2688 2239544 746512 8.36 268676 2322412 4 01:53:01 AM 4919200 6989576 2963232 37.59 2688 2239548 746512 8.36 268672 2322136 4 01:54:01 AM 4919152 6989604 2963280 37.59 2688 2239624 746512 8.36 268676 2322252 4 01:55:01 AM 4919040 6989492 2963392 37.59 2688 2239624 746512 8.36 268680 2322376 4 01:56:01 AM 4919052 6989580 2963380 37.59 2688 2239700 746512 8.36 268672 2322412 4 01:57:01 AM 4918752 6989280 2963680 37.60 2688 2239700 746512 8.36 268672 2322284 4 01:58:01 AM 4918732 6989396 2963700 37.60 2688 2239844 746512 8.36 268672 2322444 72 01:59:01 AM 4916060 6986816 2966372 37.63 2688 2239928 764144 8.56 268672 2324992 4 02:00:01 AM 4915832 6986652 2966600 37.64 2688 2239992 743720 8.33 268672 2325184 0 02:01:01 AM 4915124 6985956 2967308 37.64 2688 2240000 759116 8.50 268672 2325564 4 02:02:01 AM 4916124 6987020 2966308 37.63 2688 2240064 759116 8.50 268680 2325036 72 02:03:01 AM 4915544 6986788 2966888 37.64 2688 2240412 759116 8.50 268680 2325700 116 02:04:01 AM 4915252 6986796 2967180 37.64 2688 2240712 759116 8.50 268680 2325692 40 02:05:01 AM 4915048 6986936 2967384 37.65 2688 2241056 759116 8.50 268680 2326104 16 02:06:01 AM 4915152 6987388 2967280 37.64 2688 2241412 759116 8.50 268680 2326132 112 02:07:01 AM 4914672 6987272 2967760 37.65 2688 2241776 759116 8.50 268680 2326612 56 02:08:01 AM 4914500 6987424 2967932 37.65 2688 2242100 759116 8.50 268680 2326820 196 02:09:01 AM 4914164 6987312 2968268 37.66 2688 2242312 759116 8.50 268680 2327040 4 02:10:01 AM 4915252 6988512 2967180 37.64 2688 2242424 745716 8.35 268680 2325780 16 02:11:01 AM 4915364 6989016 2967068 37.64 2688 2242808 745716 8.35 268680 2325704 204 02:12:01 AM 4914784 6988788 2967648 37.65 2688 2243160 745716 8.35 268680 2326380 152 02:13:01 AM 4915136 6989488 2967296 37.64 2688 2243508 745716 8.35 268680 2326204 48 02:14:01 AM 4914648 6989348 2967784 37.65 2688 2243864 745716 8.35 268680 2326552 4 02:15:01 AM 4913996 6989024 2968436 37.66 2688 2244192 745716 8.35 268680 2327064 64 02:16:01 AM 4913976 6989352 2968456 37.66 2688 2244540 745716 8.35 268680 2327228 48 02:17:01 AM 4913820 6989496 2968612 37.66 2688 2244856 745716 8.35 268680 2327524 188 02:18:01 AM 4913412 6989304 2969020 37.67 2688 2245056 745716 8.35 268680 2327748 136 02:19:01 AM 4912932 6989176 2969500 37.67 2688 2245404 745716 8.35 268680 2328164 208 02:20:01 AM 4911808 6988408 2970624 37.69 2688 2245752 745736 8.35 268680 2329260 152 02:21:01 AM 4911888 6988848 2970544 37.69 2688 2246112 745736 8.35 268680 2329304 104 02:22:01 AM 4911720 6989024 2970712 37.69 2688 2246464 745736 8.35 268680 2329248 68 02:23:01 AM 4911212 6988876 2971220 37.69 2688 2246812 745736 8.35 268680 2329736 180 02:24:02 AM 4910980 6989120 2971452 37.70 2688 2247288 745736 8.35 268680 2330264 264 02:25:01 AM 4910600 6989148 2971832 37.70 2688 2247696 745736 8.35 268680 2330616 4 02:26:01 AM 4910692 6989240 2971740 37.70 2688 2247696 745736 8.35 268680 2330552 4 02:27:01 AM 4910708 6989260 2971724 37.70 2688 2247708 745736 8.35 268680 2330552 16 02:28:01 AM 4910740 6989368 2971692 37.70 2688 2247776 745736 8.35 268680 2330748 4 02:29:01 AM 4910456 6989084 2971976 37.70 2688 2247776 745736 8.35 268680 2330748 4 02:30:01 AM 4909632 6988336 2972800 37.71 2688 2247852 738032 8.26 268680 2331280 4 02:31:01 AM 4910492 6989196 2971940 37.70 2688 2247852 738032 8.26 268680 2330824 8 02:32:01 AM 4909744 6988628 2972688 37.71 2688 2248032 738032 8.26 268680 2331232 184 02:33:01 AM 4909852 6988788 2972580 37.71 2688 2248084 738032 8.26 268680 2331176 24 02:34:01 AM 4909932 6988932 2972500 37.71 2688 2248148 738032 8.26 268680 2331044 8 02:35:01 AM 4909888 6988892 2972544 37.71 2688 2248152 738032 8.26 268680 2331136 4 02:36:01 AM 4907812 6986992 2974620 37.74 2688 2248328 754668 8.45 268680 2333412 120 02:37:01 AM 4907604 6987144 2974828 37.74 2688 2248696 754668 8.45 268680 2333648 24 02:38:01 AM 4906968 6986860 2975464 37.75 2688 2249040 754668 8.45 268680 2334008 160 02:39:01 AM 4906852 6987096 2975580 37.75 2688 2249392 754668 8.45 268680 2334360 88 02:40:01 AM 4906000 6986592 2976432 37.76 2688 2249748 754668 8.45 268680 2335012 92 02:41:01 AM 4905892 6986832 2976540 37.76 2688 2250096 754668 8.45 268680 2335264 4 02:42:01 AM 4905596 6986900 2976836 37.77 2688 2250448 754668 8.45 268680 2335624 4 02:43:01 AM 4905444 6986840 2976988 37.77 2688 2250540 754668 8.45 268680 2335716 4 02:44:01 AM 4905244 6986884 2977188 37.77 2688 2250784 748036 8.38 268680 2336064 24 02:45:01 AM 4904820 6986876 2977612 37.78 2688 2251208 748036 8.38 268680 2336348 112 02:46:01 AM 4904776 6987172 2977656 37.78 2688 2251548 748036 8.38 268680 2336504 32 02:47:01 AM 4904444 6987204 2977988 37.78 2688 2251904 748036 8.38 268680 2336868 208 02:48:01 AM 4903680 6986792 2978752 37.79 2688 2252264 748036 8.38 268680 2337492 80 02:49:01 AM 4903416 6986852 2979016 37.79 2688 2252588 748036 8.38 268680 2337616 40 02:50:01 AM 4902540 6986340 2979892 37.80 2688 2252952 737636 8.26 268680 2338396 96 02:51:01 AM 4902148 6986528 2980284 37.81 2688 2253524 737636 8.26 268680 2338884 80 02:52:01 AM 4902356 6986744 2980076 37.81 2688 2253532 737636 8.26 268680 2338780 4 02:53:01 AM 4902148 6986536 2980284 37.81 2688 2253532 737636 8.26 268680 2338896 4 02:54:01 AM 4902468 6986932 2979964 37.81 2688 2253608 737636 8.26 268680 2338652 4 02:55:01 AM 4902480 6986948 2979952 37.80 2688 2253612 753012 8.43 268680 2338724 4 02:56:01 AM 4902712 6987252 2979720 37.80 2688 2253684 753012 8.43 268680 2338728 4 02:57:01 AM 4902688 6987228 2979744 37.80 2688 2253684 753012 8.43 268680 2338728 4 02:58:01 AM 4902128 6986848 2980304 37.81 2688 2253864 753012 8.43 268688 2339004 4 02:59:01 AM 4902020 6986796 2980412 37.81 2688 2253920 753012 8.43 268680 2339092 4 03:00:01 AM 4901160 6986012 2981272 37.82 2688 2253988 763192 8.55 278416 2329956 16 03:01:01 AM 4900592 6985448 2981840 37.83 2688 2253992 763192 8.55 278416 2330340 4 03:02:01 AM 4901636 6986564 2980796 37.82 2688 2254064 763192 8.55 278416 2329656 4 03:03:01 AM 4901980 6986912 2980452 37.81 2688 2254068 763192 8.55 278416 2329416 4 03:04:01 AM 4901776 6986784 2980656 37.81 2688 2254144 763192 8.55 278416 2329492 4 03:05:01 AM 4901576 6986584 2980856 37.82 2688 2254144 763192 8.55 278416 2329676 4 03:06:01 AM 4901624 6986712 2980808 37.82 2688 2254224 763192 8.55 278416 2329688 4 03:07:01 AM 4901736 6986824 2980696 37.81 2688 2254224 747312 8.37 278416 2329552 4 03:08:01 AM 4901740 6986908 2980692 37.81 2688 2254304 747312 8.37 278416 2329768 88 03:09:01 AM 4901740 6986912 2980692 37.81 2688 2254308 747312 8.37 278416 2329636 4 03:10:01 AM 4901040 6986300 2981392 37.82 2688 2254396 765704 8.57 278416 2330044 96 03:11:01 AM 4901396 6986660 2981036 37.82 2688 2254400 765704 8.57 278416 2329932 4 03:12:01 AM 4901508 6986848 2980924 37.82 2688 2254476 765704 8.57 278416 2329824 84 03:13:01 AM 4901516 6986856 2980916 37.82 2688 2254476 765704 8.57 278416 2329824 4 03:14:01 AM 4901256 6986680 2981176 37.82 2688 2254560 765704 8.57 278424 2330016 88 03:15:01 AM 4900928 6986604 2981504 37.82 2688 2254812 765704 8.57 278424 2330332 252 03:16:01 AM 4900944 6986980 2981488 37.82 2688 2255172 765704 8.57 278424 2330508 40 03:17:01 AM 4900572 6986964 2981860 37.83 2688 2255536 765704 8.57 278424 2330864 24 03:18:01 AM 4899992 6986732 2982440 37.84 2688 2255876 765704 8.57 278424 2331332 4 03:19:01 AM 4899560 6986636 2982872 37.84 2688 2256212 765704 8.57 278424 2331832 36 03:20:01 AM 4899020 6986440 2983412 37.85 2688 2256556 757872 8.49 278424 2332328 160 03:21:01 AM 4899184 6986908 2983248 37.85 2688 2256856 757872 8.49 278424 2332224 24 03:22:01 AM 4899044 6986896 2983388 37.85 2688 2256984 757872 8.49 278424 2332564 104 03:23:01 AM 4899092 6986944 2983340 37.85 2688 2256988 757872 8.49 278424 2332480 4 03:24:01 AM 4898816 6986764 2983616 37.85 2688 2257084 757872 8.49 278424 2332580 104 03:25:01 AM 4898604 6986552 2983828 37.85 2688 2257084 757872 8.49 278424 2332740 16 03:26:01 AM 4898640 6986684 2983792 37.85 2688 2257180 757872 8.49 278424 2332700 104 03:27:01 AM 4898808 6986852 2983624 37.85 2688 2257180 757872 8.49 278424 2332700 4 03:28:01 AM 4898668 6986804 2983764 37.85 2688 2257272 757872 8.49 278424 2332676 100 03:29:01 AM 4898792 6986932 2983640 37.85 2688 2257276 757872 8.49 278424 2332680 4 03:30:01 AM 4898116 6986256 2984316 37.86 2688 2257276 755628 8.46 278424 2333212 4 03:31:01 AM 4898220 6986456 2984212 37.86 2688 2257372 755628 8.46 278424 2333324 4 03:32:02 AM 4897592 6985832 2984840 37.87 2688 2257376 755628 8.46 278424 2333788 4 03:33:01 AM 4897460 6985792 2984972 37.87 2688 2257468 755628 8.46 278424 2334088 4 03:34:01 AM 4897224 6985560 2985208 37.87 2688 2257472 755628 8.46 278424 2334208 4 03:35:01 AM 4896500 6984968 2985932 37.88 2688 2257604 755628 8.46 278424 2334764 32 03:36:01 AM 4895632 6984492 2986800 37.89 2688 2258004 755628 8.46 278424 2335840 184 03:37:01 AM 4895144 6984364 2987288 37.90 2688 2258356 755628 8.46 278424 2336200 112 03:38:01 AM 4894928 6984500 2987504 37.90 2688 2258716 755628 8.46 278424 2336552 48 03:39:01 AM 4894604 6984512 2987828 37.90 2688 2259044 755628 8.46 278424 2336888 136 03:40:01 AM 4893564 6983824 2988868 37.92 2688 2259404 771040 8.63 278424 2337660 128 03:41:01 AM 4893500 6984104 2988932 37.92 2688 2259748 771040 8.63 278424 2337788 40 03:42:01 AM 4893596 6984416 2988836 37.92 2688 2259956 771040 8.63 278424 2338012 108 03:43:01 AM 4893388 6984208 2989044 37.92 2688 2259956 771040 8.63 278424 2338012 4 03:44:01 AM 4893364 6984276 2989068 37.92 2688 2260048 771040 8.63 278424 2338020 100 03:45:01 AM 4893312 6984228 2989120 37.92 2688 2260052 771040 8.63 278424 2338092 4 03:46:01 AM 4893372 6984380 2989060 37.92 2688 2260144 771040 8.63 278424 2338108 100 03:47:01 AM 4893540 6984548 2988892 37.92 2688 2260144 771040 8.63 278424 2338012 4 03:48:01 AM 4893516 6984528 2988916 37.92 2688 2260148 771040 8.63 278424 2338132 4 03:49:01 AM 4893412 6984516 2989020 37.92 2688 2260240 771040 8.63 278424 2338232 4 03:50:01 AM 4892696 6983800 2989736 37.93 2688 2260240 757436 8.48 278424 2338532 8 03:51:01 AM 4892684 6983884 2989748 37.93 2688 2260336 757436 8.48 278424 2338544 4 03:52:01 AM 4892688 6983888 2989744 37.93 2688 2260336 757436 8.48 278424 2338428 4 03:53:01 AM 4892928 6984224 2989504 37.93 2688 2260432 757436 8.48 278424 2338312 4 03:54:01 AM 4892956 6984252 2989476 37.93 2688 2260432 757436 8.48 278424 2338312 4 03:55:01 AM 4892672 6984160 2989760 37.93 2688 2260624 757436 8.48 278424 2338580 88 03:56:01 AM 4892308 6984148 2990124 37.93 2688 2260976 757436 8.48 278424 2339168 188 03:57:01 AM 4891804 6983988 2990628 37.94 2688 2261320 757436 8.48 278424 2339516 120 03:58:01 AM 4891536 6984072 2990896 37.94 2688 2261680 757436 8.48 278424 2339980 96 03:59:01 AM 4890492 6983388 2991940 37.96 2688 2262040 757436 8.48 278424 2340772 24 04:00:01 AM 4890296 6983540 2992136 37.96 2688 2262376 757488 8.48 278424 2341020 144 04:01:01 AM 4889528 6983132 2992904 37.97 2688 2262736 757488 8.48 278424 2341752 56 04:02:01 AM 4890268 6984056 2992164 37.96 2688 2262920 757488 8.48 278432 2341152 4 04:03:01 AM 4890068 6983856 2992364 37.96 2688 2262920 757488 8.48 278432 2341268 4 04:04:01 AM 4890196 6984076 2992236 37.96 2688 2263012 757488 8.48 278432 2341244 100 04:05:01 AM 4890076 6983960 2992356 37.96 2688 2263016 757488 8.48 278432 2341316 4 04:06:01 AM 4889984 6983960 2992448 37.96 2688 2263108 757488 8.48 278432 2341332 100 04:07:01 AM 4890016 6983992 2992416 37.96 2688 2263108 757488 8.48 278432 2341340 4 04:08:01 AM 4889820 6983892 2992612 37.97 2688 2263204 757488 8.48 278432 2341428 100 04:09:01 AM 4890008 6984080 2992424 37.96 2688 2263204 757488 8.48 278432 2341436 4 04:10:01 AM 4889372 6983444 2993060 37.97 2688 2263204 752932 8.43 278432 2341968 4 04:11:01 AM 4889576 6983748 2992856 37.97 2688 2263304 752932 8.43 278432 2341536 4 04:12:01 AM 4889716 6983892 2992716 37.97 2688 2263308 752932 8.43 278432 2341540 4 04:13:01 AM 4889784 6984056 2992648 37.97 2688 2263404 752932 8.43 278432 2341640 4 04:14:01 AM 4889776 6984048 2992656 37.97 2688 2263404 752932 8.43 278432 2341756 4 04:15:01 AM 4889392 6983916 2993040 37.97 2688 2263656 752932 8.43 278432 2342056 24 04:16:01 AM 4889072 6983944 2993360 37.98 2688 2264012 752932 8.43 278432 2342360 40 04:17:01 AM 4888884 6984100 2993548 37.98 2688 2264356 752932 8.43 278432 2342588 176 04:18:01 AM 4888460 6984028 2993972 37.98 2688 2264696 752932 8.43 278432 2343064 4 04:19:01 AM 4888068 6983984 2994364 37.99 2688 2265044 752932 8.43 278432 2343288 96 04:20:01 AM 4887228 6983492 2995204 38.00 2688 2265392 768896 8.61 278432 2344096 52 04:21:01 AM 4886976 6983596 2995456 38.00 2688 2265748 739576 8.28 278432 2344292 80 04:22:01 AM 4886564 6983748 2995868 38.01 2688 2266316 739576 8.28 278432 2344860 24 04:23:01 AM 4886388 6983696 2996044 38.01 2688 2266432 739576 8.28 278432 2344988 76 04:24:01 AM 4886448 6983760 2995984 38.01 2688 2266436 739576 8.28 278432 2344992 4 04:25:01 AM 4885928 6983332 2996504 38.01 2688 2266528 750036 8.40 279488 2344092 348 04:26:01 AM 4886220 6983624 2996212 38.01 2688 2266528 750036 8.40 279488 2344024 4 04:27:01 AM 4886104 6983512 2996328 38.01 2688 2266532 750036 8.40 279488 2344028 4 04:28:01 AM 4886200 6983680 2996232 38.01 2688 2266604 750036 8.40 279488 2344104 4 04:29:01 AM 4886336 6983816 2996096 38.01 2688 2266604 750036 8.40 279488 2343900 4 04:30:01 AM 4885384 6983048 2997048 38.02 2688 2266788 751912 8.42 279488 2344632 12 04:31:01 AM 4885656 6983432 2996776 38.02 2688 2266900 751912 8.42 279488 2344428 80 04:32:01 AM 4885228 6983008 2997204 38.02 2688 2266904 751912 8.42 279488 2344820 4 04:33:02 AM 4884172 6981952 2998260 38.04 2688 2266904 751912 8.42 279488 2346008 4 04:34:01 AM 4884136 6982140 2998296 38.04 2688 2267128 751912 8.42 279488 2346016 64 04:35:01 AM 4883568 6981924 2998864 38.04 2688 2267480 751912 8.42 279488 2346652 16 04:36:01 AM 4883432 6982132 2999000 38.05 2688 2267832 751912 8.42 279488 2346716 40 04:37:01 AM 4883164 6982224 2999268 38.05 2688 2268192 751912 8.42 279488 2347196 96 04:38:01 AM 4882684 6982100 2999748 38.06 2688 2268540 751912 8.42 279488 2347548 24 04:39:01 AM 4882348 6982112 3000084 38.06 2688 2268888 751912 8.42 279488 2347780 96 04:40:01 AM 4881508 6981616 3000924 38.07 2688 2269232 774756 8.67 279488 2348544 48 04:41:01 AM 4881280 6981536 3001152 38.07 2688 2269380 755960 8.46 279488 2348868 112 04:42:01 AM 4881328 6981800 3001104 38.07 2688 2269596 755960 8.46 279488 2348776 72 04:43:01 AM 4881296 6982128 3001136 38.07 2688 2269956 755960 8.46 279488 2348884 40 04:44:01 AM 4880924 6982108 3001508 38.08 2688 2270316 755960 8.46 279488 2349236 180 04:45:01 AM 4880380 6981908 3002052 38.09 2688 2270660 755960 8.46 279488 2349764 144 04:46:01 AM 4880416 6982304 3002016 38.08 2688 2271012 755960 8.46 279488 2349940 4 04:47:01 AM 4879920 6982152 3002512 38.09 2688 2271356 755960 8.46 279488 2350280 24 04:48:01 AM 4879736 6982264 3002696 38.09 2688 2271652 755960 8.46 279488 2350580 4 04:49:01 AM 4879408 6982176 3003024 38.10 2688 2271892 755960 8.46 279488 2350924 4 04:50:01 AM 4878492 6981564 3003940 38.11 2688 2272196 741104 8.30 279488 2351528 160 04:51:01 AM 4878336 6981772 3004096 38.11 2688 2272556 741104 8.30 279488 2351792 120 04:52:01 AM 4878472 6982240 3003960 38.11 2688 2272896 741104 8.30 279488 2351804 76 04:53:01 AM 4877908 6982036 3004524 38.12 2688 2273244 741104 8.30 279488 2352160 4 04:54:01 AM 4877072 6981520 3005360 38.13 2688 2273572 741104 8.30 279488 2353008 96 04:55:01 AM 4877276 6982084 3005156 38.12 2688 2273932 741104 8.30 279488 2352940 72 04:56:01 AM 4876780 6982208 3005652 38.13 2688 2274552 741104 8.30 279488 2353608 24 04:57:01 AM 4876840 6982360 3005592 38.13 2688 2274636 741104 8.30 279488 2353588 4 04:58:01 AM 4876868 6982388 3005564 38.13 2688 2274636 741104 8.30 279488 2353588 4 04:59:01 AM 4876480 6982084 3005952 38.13 2688 2274720 741104 8.30 279488 2353672 4 05:00:01 AM 4875580 6981184 3006852 38.15 2688 2274720 741592 8.30 279488 2354520 4 05:01:01 AM 4875104 6980784 3007328 38.15 2688 2274796 741592 8.30 279488 2354992 80 05:02:01 AM 4876144 6981824 3006288 38.14 2688 2274796 741592 8.30 279492 2354180 4 05:03:01 AM 4875988 6981792 3006444 38.14 2688 2274920 741592 8.30 279492 2354308 132 05:04:01 AM 4875716 6981620 3006716 38.14 2688 2275020 757336 8.48 279492 2354416 56 05:05:01 AM 4875384 6981440 3007048 38.15 2688 2275172 757336 8.48 279500 2354636 4 05:06:01 AM 4875584 6981640 3006848 38.15 2688 2275172 757336 8.48 279500 2354572 4 05:07:01 AM 4875588 6981688 3006844 38.15 2688 2275216 757336 8.48 279500 2354616 4 05:08:01 AM 4875280 6981484 3007152 38.15 2688 2275320 757336 8.48 279500 2354816 56 05:09:01 AM 4875604 6981864 3006828 38.15 2688 2275376 757336 8.48 279500 2354872 4 05:10:01 AM 4874768 6981096 3007664 38.16 2688 2275444 749816 8.40 279500 2355212 16 05:11:01 AM 4875020 6981488 3007412 38.15 2688 2275584 749816 8.40 279504 2355060 4 05:12:01 AM 4874832 6981304 3007600 38.16 2688 2275588 749816 8.40 279504 2355184 4 05:13:01 AM 4874812 6981432 3007620 38.16 2688 2275728 749816 8.40 279504 2355208 16 05:14:01 AM 4874724 6981736 3007708 38.16 2688 2276120 749816 8.40 279504 2355608 48 05:15:01 AM 4874204 6981564 3008228 38.16 2688 2276476 749816 8.40 279504 2356140 188 05:16:01 AM 4873768 6981484 3008664 38.17 2688 2276824 749816 8.40 279504 2356316 128 05:17:01 AM 4873720 6981788 3008712 38.17 2688 2277176 749816 8.40 279504 2356664 80 05:18:01 AM 4873132 6981552 3009300 38.18 2688 2277532 749816 8.40 279504 2357012 24 05:19:01 AM 4872444 6981212 3009988 38.19 2688 2277880 749816 8.40 279504 2357884 184 05:20:01 AM 4871652 6980972 3010780 38.20 2688 2278424 767420 8.59 279504 2358328 40 05:21:01 AM 4871548 6981156 3010884 38.20 2688 2278712 767420 8.59 279504 2358540 4 05:22:01 AM 4871308 6981196 3011124 38.20 2688 2278992 767420 8.59 279504 2358704 100 05:23:01 AM 4871312 6981480 3011120 38.20 2688 2279272 767420 8.59 279504 2358984 192 05:24:01 AM 4870988 6981436 3011444 38.20 2688 2279560 767420 8.59 279504 2359380 140 05:25:01 AM 4870964 6981692 3011468 38.20 2688 2279840 767420 8.59 279504 2359388 4 05:26:01 AM 4872472 6983508 3009960 38.19 2688 2280140 746672 8.36 279504 2357692 4 05:27:01 AM 4870652 6981756 3011780 38.21 2688 2280208 762248 8.53 279504 2359692 16 05:28:01 AM 4870148 6981468 3012284 38.22 2688 2280424 762248 8.53 279512 2359896 4 05:29:01 AM 4870284 6981676 3012148 38.21 2688 2280496 762248 8.53 279512 2359968 4 05:30:01 AM 4869388 6980900 3013044 38.22 2688 2280616 765720 8.57 279512 2360628 0 05:31:01 AM 4869604 6981388 3012828 38.22 2688 2280888 765720 8.57 279512 2360696 4 05:32:01 AM 4869196 6981232 3013236 38.23 2688 2281140 765720 8.57 279512 2361040 104 05:33:01 AM 4868868 6981252 3013564 38.23 2688 2281496 765720 8.57 279512 2361184 16 05:34:01 AM 4868896 6981632 3013536 38.23 2688 2281840 765720 8.57 279512 2361316 128 05:35:01 AM 4868272 6981372 3014160 38.24 2688 2282200 765720 8.57 279512 2361944 16 05:36:01 AM 4868160 6981608 3014272 38.24 2688 2282556 765720 8.57 279512 2362020 172 05:37:01 AM 4867596 6981404 3014836 38.25 2688 2282916 765720 8.57 279512 2362496 4 05:38:01 AM 4867168 6981648 3015264 38.25 2688 2283588 765720 8.57 279512 2363168 476 05:39:01 AM 4867080 6981684 3015352 38.25 2688 2283704 765720 8.57 279512 2363296 4 05:40:01 AM 4866508 6981112 3015924 38.26 2688 2283704 760436 8.51 279512 2363596 4 05:41:02 AM 4866828 6981524 3015604 38.26 2688 2283792 760436 8.51 279512 2363488 88 05:42:01 AM 4866668 6981364 3015764 38.26 2688 2283792 760436 8.51 279512 2363488 4 05:43:01 AM 4866896 6981604 3015536 38.26 2688 2283804 760436 8.51 279512 2363276 16 05:44:01 AM 4866756 6981528 3015676 38.26 2688 2283868 760436 8.51 279512 2363344 4 05:45:01 AM 4866784 6981556 3015648 38.26 2688 2283868 760436 8.51 279512 2363412 4 05:46:01 AM 4866708 6981668 3015724 38.26 2688 2284056 775888 8.69 279512 2363652 16 05:47:01 AM 4866552 6981696 3015880 38.26 2688 2284240 775888 8.69 279516 2363716 32 05:48:01 AM 4866392 6981536 3016040 38.26 2688 2284240 760464 8.51 279516 2363716 4 05:49:01 AM 4866060 6981252 3016372 38.27 2688 2284288 756524 8.47 279784 2363720 4 05:50:01 AM 4865812 6981020 3016620 38.27 2688 2284304 758864 8.50 279784 2364036 4 05:51:01 AM 4866168 6981416 3016264 38.27 2688 2284344 758864 8.50 279784 2363556 48 05:52:01 AM 4866016 6981412 3016416 38.27 2688 2284492 758864 8.50 279788 2363700 4 05:53:01 AM 4866032 6981432 3016400 38.27 2688 2284496 758864 8.50 279788 2363704 4 05:54:01 AM 4865896 6981436 3016536 38.27 2688 2284636 758864 8.50 279788 2363836 4 05:55:01 AM 4865316 6981192 3017116 38.28 2688 2284972 758864 8.50 279788 2364372 80 05:56:01 AM 4865192 6981424 3017240 38.28 2688 2285332 774344 8.67 279788 2364544 44 05:57:01 AM 4864620 6981208 3017812 38.29 2688 2285692 774344 8.67 279788 2365016 200 05:58:01 AM 4864540 6981488 3017892 38.29 2688 2286044 774344 8.67 279788 2365376 128 05:59:01 AM 4864080 6981388 3018352 38.29 2688 2286404 774344 8.67 279788 2365736 40 06:00:01 AM 4863100 6980744 3019332 38.30 2688 2286748 774344 8.67 279788 2366372 192 06:01:01 AM 4862496 6980772 3019936 38.31 2688 2287368 774344 8.67 279788 2367044 160 06:02:01 AM 4862912 6981280 3019520 38.31 2688 2287452 774344 8.67 279788 2366772 4 06:03:01 AM 4863096 6981464 3019336 38.30 2688 2287452 774344 8.67 279788 2366676 4 06:04:01 AM 4862980 6981432 3019452 38.31 2688 2287536 774344 8.67 279788 2366876 4 06:05:01 AM 4863020 6981472 3019412 38.31 2688 2287536 774344 8.67 279788 2366944 4 06:06:01 AM 4862772 6981296 3019660 38.31 2688 2287608 774344 8.67 279788 2366828 80 06:07:01 AM 4862764 6981292 3019668 38.31 2688 2287612 774344 8.67 279788 2366916 4 06:08:01 AM 4862732 6981372 3019700 38.31 2688 2287740 753692 8.44 279788 2366944 136 06:09:01 AM 4862192 6981044 3020240 38.32 2688 2287936 769652 8.62 279788 2367212 156 06:10:01 AM 4859052 6978124 3023380 38.36 2688 2288164 792688 8.88 279792 2370104 88 06:11:01 AM 4858860 6978120 3023572 38.36 2688 2288340 808128 9.05 279792 2370272 4 06:12:01 AM 4857516 6977152 3024916 38.38 2688 2288708 841072 9.42 279792 2371204 40 06:13:01 AM 4855080 6974948 3027352 38.41 2688 2288940 864608 9.68 279792 2373664 16 06:14:01 AM 4854748 6974800 3027684 38.41 2688 2289124 898780 10.06 279792 2374040 16 06:15:01 AM 4851748 6972176 3030684 38.45 2688 2289492 931980 10.44 279792 2376580 16 06:16:01 AM 4958500 6984324 2923932 37.09 2688 2200924 686260 7.68 352512 2217252 92492 Average: 4904946 6987250 2977486 37.77 2688 2251573 755575 8.46 273960 2331275 1261 12:24:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 AM eth0 275.90 180.47 1576.57 60.51 0.00 0.00 0.00 0.00 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 AM eth0 53.52 43.74 552.72 7.86 0.00 0.00 0.00 0.00 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 AM eth0 23.33 10.10 12.56 3.58 0.00 0.00 0.00 0.00 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 AM eth0 36.91 28.86 268.87 6.13 0.00 0.00 0.00 0.00 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 AM eth0 600.12 479.44 122.23 101.51 0.00 0.00 0.00 0.00 12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:01 AM eth0 25.89 15.94 13.86 3.16 0.00 0.00 0.00 0.00 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 AM eth0 20.11 19.58 3.84 2.73 0.00 0.00 0.00 0.00 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 AM eth0 11.36 9.73 2.44 1.99 0.00 0.00 0.00 0.00 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 AM eth0 10.18 9.83 2.57 2.17 0.00 0.00 0.00 0.00 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 AM eth0 8.83 8.88 1.82 1.62 0.00 0.00 0.00 0.00 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 AM eth0 9.90 9.87 2.11 1.88 0.00 0.00 0.00 0.00 12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:01 AM eth0 9.81 9.80 2.04 1.82 0.00 0.00 0.00 0.00 12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 AM eth0 14.98 14.73 3.36 2.72 0.00 0.00 0.00 0.00 12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 AM eth0 0.65 0.48 0.11 0.07 0.00 0.00 0.00 0.00 12:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:01 AM eth0 6.10 0.10 0.73 0.01 0.00 0.00 0.00 0.00 12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 AM eth0 1.32 0.82 0.66 0.49 0.00 0.00 0.00 0.00 12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 AM eth0 1.42 0.28 0.42 0.20 0.00 0.00 0.00 0.00 12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 AM eth0 10.08 0.32 1.31 0.04 0.00 0.00 0.00 0.00 12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 AM eth0 3.17 0.33 0.48 0.23 0.00 0.00 0.00 0.00 12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 AM eth0 1.83 0.25 0.44 0.23 0.00 0.00 0.00 0.00 12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 AM eth0 11.11 10.70 2.40 1.43 0.00 0.00 0.00 0.00 12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:01 AM eth0 3.58 2.68 0.64 0.24 0.00 0.00 0.00 0.00 12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 AM eth0 1.05 0.62 0.15 0.10 0.00 0.00 0.00 0.00 12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 AM eth0 1.42 0.32 0.36 0.20 0.00 0.00 0.00 0.00 12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 AM eth0 5.23 2.63 0.87 0.24 0.00 0.00 0.00 0.00 12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:01 AM eth0 1.60 0.80 1.04 0.69 0.00 0.00 0.00 0.00 12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 AM eth0 0.37 0.05 0.02 0.00 0.00 0.00 0.00 0.00 12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 AM eth0 8.02 3.78 1.18 0.33 0.00 0.00 0.00 0.00 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 1.37 0.22 0.38 0.22 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 3.80 3.08 0.65 0.23 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 2.02 1.02 0.62 0.39 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 1.33 0.28 0.36 0.20 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 5.27 4.97 0.78 0.35 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 1.17 0.57 0.15 0.09 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 3.35 0.00 0.37 0.00 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 4.63 3.70 1.31 0.76 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 1.52 0.25 0.13 0.03 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 8.64 0.05 1.13 0.00 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 5.98 4.62 0.83 0.38 0.00 0.00 0.00 0.00 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 AM eth0 1.07 0.00 0.12 0.00 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 3.77 3.35 0.88 0.48 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 2.00 1.48 0.17 0.18 0.00 0.00 0.00 0.00 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 AM eth0 1.13 0.32 0.33 0.20 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 0.80 0.20 0.09 0.01 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 3.62 0.20 0.61 0.19 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 1.52 0.37 0.43 0.26 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 1.32 0.07 0.06 0.00 0.00 0.00 0.00 0.00 01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:01 AM eth0 5.67 0.10 0.72 0.00 0.00 0.00 0.00 0.00 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 AM eth0 0.53 0.00 0.03 0.00 0.00 0.00 0.00 0.00 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 AM eth0 9.35 8.62 1.62 0.95 0.00 0.00 0.00 0.00 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 AM eth0 11.00 11.21 2.36 2.11 0.00 0.00 0.00 0.00 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 AM eth0 9.86 9.73 2.10 1.81 0.00 0.00 0.00 0.00 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 AM eth0 9.50 9.48 2.01 1.79 0.00 0.00 0.00 0.00 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 AM eth0 9.64 9.68 2.01 1.79 0.00 0.00 0.00 0.00 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 AM eth0 13.51 9.37 2.43 1.76 0.00 0.00 0.00 0.00 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 AM eth0 12.13 10.01 2.68 2.23 0.00 0.00 0.00 0.00 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 AM eth0 17.56 12.98 3.29 2.44 0.00 0.00 0.00 0.00 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 AM eth0 5.63 0.38 0.72 0.05 0.00 0.00 0.00 0.00 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 AM eth0 1.12 0.05 0.14 0.00 0.00 0.00 0.00 0.00 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 AM eth0 0.92 0.40 0.10 0.05 0.00 0.00 0.00 0.00 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 AM eth0 0.97 0.08 0.16 0.06 0.00 0.00 0.00 0.00 01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:01 AM eth0 1.15 0.45 0.35 0.23 0.00 0.00 0.00 0.00 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 AM eth0 0.52 0.10 0.08 0.01 0.00 0.00 0.00 0.00 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 AM eth0 7.77 7.48 1.53 0.92 0.00 0.00 0.00 0.00 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 AM eth0 5.23 3.22 0.99 0.44 0.00 0.00 0.00 0.00 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 AM eth0 1.05 0.77 0.28 0.22 0.00 0.00 0.00 0.00 01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:01 AM eth0 0.87 0.15 0.11 0.01 0.00 0.00 0.00 0.00 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 AM eth0 3.28 0.40 0.64 0.21 0.00 0.00 0.00 0.00 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 AM eth0 0.75 0.22 0.32 0.23 0.00 0.00 0.00 0.00 01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 AM eth0 2.83 2.38 0.49 0.22 0.00 0.00 0.00 0.00 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM eth0 9.40 9.60 2.03 1.81 0.00 0.00 0.00 0.00 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 AM eth0 9.92 9.73 2.05 1.81 0.00 0.00 0.00 0.00 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 AM eth0 8.45 8.35 1.76 1.55 0.00 0.00 0.00 0.00 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 AM eth0 10.13 9.50 2.09 1.77 0.00 0.00 0.00 0.00 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 AM eth0 13.86 9.66 2.46 1.79 0.00 0.00 0.00 0.00 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 AM eth0 11.20 10.18 2.68 2.26 0.00 0.00 0.00 0.00 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 AM eth0 4.17 2.97 0.77 0.54 0.00 0.00 0.00 0.00 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 AM eth0 6.41 0.35 0.81 0.06 0.00 0.00 0.00 0.00 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 AM eth0 1.40 0.18 0.39 0.19 0.00 0.00 0.00 0.00 01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:01 AM eth0 2.37 1.90 0.38 0.35 0.00 0.00 0.00 0.00 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 AM eth0 9.43 9.17 2.04 1.76 0.00 0.00 0.00 0.00 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 AM eth0 9.83 9.50 2.02 1.78 0.00 0.00 0.00 0.00 01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:01 AM eth0 9.75 9.73 2.09 1.81 0.00 0.00 0.00 0.00 01:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:01 AM eth0 9.33 8.98 1.90 1.67 0.00 0.00 0.00 0.00 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 AM eth0 11.01 9.76 2.20 1.81 0.00 0.00 0.00 0.00 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 AM eth0 9.80 9.35 2.51 2.14 0.00 0.00 0.00 0.00 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 AM eth0 16.74 14.26 3.56 2.59 0.00 0.00 0.00 0.00 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 AM eth0 1.13 0.40 0.18 0.06 0.00 0.00 0.00 0.00 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 AM eth0 0.37 0.00 0.02 0.00 0.00 0.00 0.00 0.00 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 AM eth0 0.60 0.33 0.08 0.04 0.00 0.00 0.00 0.00 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 AM eth0 0.43 0.12 0.09 0.07 0.00 0.00 0.00 0.00 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 AM eth0 0.75 0.33 0.09 0.04 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 0.38 0.05 0.07 0.00 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 4.08 3.67 0.86 0.67 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 8.02 7.55 1.62 0.73 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 1.45 0.68 0.26 0.16 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 1.33 0.17 0.19 0.01 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 3.58 2.85 0.55 0.21 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 12.76 9.88 2.64 2.02 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 11.30 8.90 3.19 2.52 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 9.85 9.75 2.57 2.21 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 14.43 9.73 2.74 1.81 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 13.75 9.76 2.56 1.81 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 9.41 8.93 1.90 1.67 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 7.38 4.50 1.23 0.83 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 1.68 1.25 0.52 0.46 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 10.71 10.21 2.19 1.89 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 9.93 9.85 2.32 2.00 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 15.23 9.33 2.73 1.74 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 10.40 9.65 2.10 1.81 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 9.45 9.13 2.05 1.76 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 9.50 9.41 1.96 1.76 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 4.62 4.22 0.85 0.76 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 4.13 4.00 0.78 0.73 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 14.46 9.28 2.50 1.74 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 10.75 10.28 2.92 2.45 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 9.93 9.82 2.49 2.16 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 14.21 9.48 2.64 1.76 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 10.95 9.88 2.18 1.82 0.00 0.00 0.00 0.00 02:24:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:02 AM eth0 14.06 12.53 2.83 2.37 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 8.80 7.86 2.01 1.43 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 2.33 0.12 0.33 0.01 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 0.55 0.05 0.03 0.00 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 0.75 0.35 0.09 0.05 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 2.02 0.05 0.21 0.00 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 1.72 0.97 0.72 0.54 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 1.78 0.05 0.23 0.00 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 9.43 7.50 1.98 1.10 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 6.47 3.75 1.45 0.74 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 0.55 0.28 0.09 0.03 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 0.83 0.20 0.17 0.07 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 5.68 5.45 1.09 0.77 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 10.00 10.00 2.09 1.86 0.00 0.00 0.00 0.00 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 AM eth0 9.51 9.66 2.02 1.80 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 12.80 9.31 3.13 1.74 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 10.71 9.83 2.15 1.88 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 9.85 9.75 2.04 1.81 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 9.56 9.36 2.00 1.74 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 1.23 0.92 0.17 0.17 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 2.85 2.67 0.50 0.49 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 11.36 11.10 2.47 2.10 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 9.45 9.60 2.02 1.80 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 9.56 9.28 1.99 1.74 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 10.03 9.97 2.33 2.04 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 11.93 9.51 2.08 1.76 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 11.23 9.52 2.14 1.81 0.00 0.00 0.00 0.00 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 AM eth0 12.43 12.20 2.83 2.20 0.00 0.00 0.00 0.00 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 AM eth0 0.32 0.03 0.01 0.00 0.00 0.00 0.00 0.00 02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:01 AM eth0 0.17 0.07 0.01 0.00 0.00 0.00 0.00 0.00 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 AM eth0 0.52 0.33 0.07 0.04 0.00 0.00 0.00 0.00 02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:01 AM eth0 0.45 0.15 0.20 0.07 0.00 0.00 0.00 0.00 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 AM eth0 0.67 0.28 0.08 0.04 0.00 0.00 0.00 0.00 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 AM eth0 0.18 0.05 0.01 0.00 0.00 0.00 0.00 0.00 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 AM eth0 7.07 7.02 1.51 0.93 0.00 0.00 0.00 0.00 02:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:01 AM eth0 2.53 2.38 0.54 0.21 0.00 0.00 0.00 0.00 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 0.82 0.72 0.20 0.16 0.00 0.00 0.00 0.00 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 AM eth0 0.48 0.13 0.06 0.01 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 0.65 0.35 0.22 0.04 0.00 0.00 0.00 0.00 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 AM eth0 0.27 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 0.55 0.27 0.08 0.03 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 0.37 0.12 0.09 0.07 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 0.53 0.30 0.08 0.03 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 0.20 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 0.47 0.28 0.09 0.03 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 0.32 0.13 0.09 0.01 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 2.42 0.45 0.27 0.10 0.00 0.00 0.00 0.00 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 AM eth0 0.32 0.12 0.07 0.01 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 0.47 0.28 0.08 0.03 0.00 0.00 0.00 0.00 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 AM eth0 1.63 1.43 0.38 0.13 0.00 0.00 0.00 0.00 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 AM eth0 6.97 7.23 1.50 1.37 0.00 0.00 0.00 0.00 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 AM eth0 10.05 9.73 2.13 1.81 0.00 0.00 0.00 0.00 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 AM eth0 9.38 9.62 2.02 1.80 0.00 0.00 0.00 0.00 03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:18:01 AM eth0 9.30 9.38 1.98 1.76 0.00 0.00 0.00 0.00 03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 AM eth0 9.80 9.56 2.27 1.91 0.00 0.00 0.00 0.00 03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 AM eth0 9.58 9.75 2.09 1.87 0.00 0.00 0.00 0.00 03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:21:01 AM eth0 7.15 6.73 1.46 1.26 0.00 0.00 0.00 0.00 03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:22:01 AM eth0 1.42 0.82 0.43 0.31 0.00 0.00 0.00 0.00 03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:23:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:24:01 AM eth0 0.82 0.18 0.07 0.02 0.00 0.00 0.00 0.00 03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:25:01 AM eth0 0.73 0.38 0.38 0.30 0.00 0.00 0.00 0.00 03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:26:01 AM eth0 0.62 0.25 0.14 0.02 0.00 0.00 0.00 0.00 03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:27:01 AM eth0 0.93 0.07 0.11 0.00 0.00 0.00 0.00 0.00 03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:28:01 AM eth0 1.45 0.10 0.09 0.01 0.00 0.00 0.00 0.00 03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:29:01 AM eth0 0.33 0.10 0.02 0.00 0.00 0.00 0.00 0.00 03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:30:01 AM eth0 0.35 0.15 0.09 0.07 0.00 0.00 0.00 0.00 03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:31:01 AM eth0 0.45 0.28 0.02 0.02 0.00 0.00 0.00 0.00 03:32:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:32:02 AM eth0 0.45 0.23 0.26 0.19 0.00 0.00 0.00 0.00 03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:33:01 AM eth0 0.41 0.25 0.02 0.02 0.00 0.00 0.00 0.00 03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:34:01 AM eth0 0.73 0.00 0.07 0.00 0.00 0.00 0.00 0.00 03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:35:01 AM eth0 2.33 1.43 0.68 0.53 0.00 0.00 0.00 0.00 03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:36:01 AM eth0 10.65 10.91 2.36 1.99 0.00 0.00 0.00 0.00 03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:37:01 AM eth0 9.36 9.68 2.02 1.81 0.00 0.00 0.00 0.00 03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:38:01 AM eth0 9.63 9.73 2.03 1.81 0.00 0.00 0.00 0.00 03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:39:01 AM eth0 8.75 8.96 1.86 1.67 0.00 0.00 0.00 0.00 03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:40:01 AM eth0 9.73 9.87 2.10 1.88 0.00 0.00 0.00 0.00 03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:41:01 AM eth0 9.61 9.78 2.08 1.81 0.00 0.00 0.00 0.00 03:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:42:01 AM eth0 1.57 1.43 0.24 0.25 0.00 0.00 0.00 0.00 03:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:43:01 AM eth0 0.10 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:44:01 AM eth0 0.45 0.23 0.02 0.02 0.00 0.00 0.00 0.00 03:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:45:01 AM eth0 0.23 0.10 0.08 0.06 0.00 0.00 0.00 0.00 03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:01 AM eth0 0.32 0.10 0.02 0.01 0.00 0.00 0.00 0.00 03:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:47:01 AM eth0 0.20 0.10 0.01 0.00 0.00 0.00 0.00 0.00 03:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:48:01 AM eth0 0.22 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:49:01 AM eth0 0.50 0.30 0.08 0.02 0.00 0.00 0.00 0.00 03:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:50:01 AM eth0 0.32 0.15 0.08 0.07 0.00 0.00 0.00 0.00 03:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:51:01 AM eth0 0.35 0.22 0.02 0.02 0.00 0.00 0.00 0.00 03:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:52:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 03:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:53:01 AM eth0 0.33 0.25 0.02 0.02 0.00 0.00 0.00 0.00 03:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:54:01 AM eth0 0.12 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:55:01 AM eth0 3.22 3.10 0.67 0.71 0.00 0.00 0.00 0.00 03:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:56:01 AM eth0 9.18 9.36 1.95 1.75 0.00 0.00 0.00 0.00 03:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:57:01 AM eth0 9.22 9.38 1.96 1.74 0.00 0.00 0.00 0.00 03:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:58:01 AM eth0 9.93 9.68 2.08 1.81 0.00 0.00 0.00 0.00 03:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:59:01 AM eth0 9.78 9.92 2.27 2.00 0.00 0.00 0.00 0.00 04:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:00:01 AM eth0 9.73 9.78 2.26 1.87 0.00 0.00 0.00 0.00 04:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:01:01 AM eth0 9.08 9.33 1.94 1.74 0.00 0.00 0.00 0.00 04:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:02:01 AM eth0 1.13 1.00 0.17 0.18 0.00 0.00 0.00 0.00 04:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:03:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:04:01 AM eth0 0.38 0.18 0.02 0.02 0.00 0.00 0.00 0.00 04:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:05:01 AM eth0 0.33 0.10 0.08 0.06 0.00 0.00 0.00 0.00 04:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:06:01 AM eth0 0.30 0.18 0.01 0.02 0.00 0.00 0.00 0.00 04:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:07:01 AM eth0 0.10 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:08:01 AM eth0 0.42 0.17 0.02 0.02 0.00 0.00 0.00 0.00 04:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:09:01 AM eth0 0.37 0.18 0.07 0.01 0.00 0.00 0.00 0.00 04:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:10:01 AM eth0 0.32 0.13 0.08 0.07 0.00 0.00 0.00 0.00 04:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:11:01 AM eth0 0.42 0.22 0.04 0.02 0.00 0.00 0.00 0.00 04:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:12:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:13:01 AM eth0 0.28 0.18 0.01 0.02 0.00 0.00 0.00 0.00 04:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:14:01 AM eth0 0.25 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:15:01 AM eth0 2.15 2.07 0.48 0.44 0.00 0.00 0.00 0.00 04:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:16:01 AM eth0 9.43 9.70 2.00 1.81 0.00 0.00 0.00 0.00 04:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:17:01 AM eth0 9.02 9.28 1.94 1.74 0.00 0.00 0.00 0.00 04:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:18:01 AM eth0 9.35 9.43 2.00 1.77 0.00 0.00 0.00 0.00 04:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:19:01 AM eth0 9.30 9.50 1.98 1.77 0.00 0.00 0.00 0.00 04:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:20:01 AM eth0 9.31 9.46 2.02 1.81 0.00 0.00 0.00 0.00 04:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:21:01 AM eth0 9.28 9.53 2.00 1.79 0.00 0.00 0.00 0.00 04:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:22:01 AM eth0 13.70 13.38 3.05 2.45 0.00 0.00 0.00 0.00 04:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:23:01 AM eth0 0.50 0.43 0.11 0.07 0.00 0.00 0.00 0.00 04:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:24:01 AM eth0 1.47 0.00 0.09 0.00 0.00 0.00 0.00 0.00 04:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:25:01 AM eth0 1.60 1.33 0.38 0.19 0.00 0.00 0.00 0.00 04:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:26:01 AM eth0 0.18 0.08 0.01 0.00 0.00 0.00 0.00 0.00 04:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:27:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:28:01 AM eth0 0.47 0.38 0.07 0.05 0.00 0.00 0.00 0.00 04:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:29:01 AM eth0 0.17 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:30:01 AM eth0 9.13 7.63 1.71 1.05 0.00 0.00 0.00 0.00 04:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:31:01 AM eth0 3.12 2.95 0.73 0.30 0.00 0.00 0.00 0.00 04:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:32:01 AM eth0 0.57 0.30 0.26 0.20 0.00 0.00 0.00 0.00 04:33:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:33:02 AM eth0 0.20 0.10 0.01 0.00 0.00 0.00 0.00 0.00 04:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:34:01 AM eth0 7.49 6.91 1.46 1.04 0.00 0.00 0.00 0.00 04:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:35:01 AM eth0 9.61 9.68 2.35 2.02 0.00 0.00 0.00 0.00 04:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:36:01 AM eth0 9.85 9.53 2.10 1.78 0.00 0.00 0.00 0.00 04:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:37:01 AM eth0 9.42 9.68 2.02 1.81 0.00 0.00 0.00 0.00 04:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:38:01 AM eth0 9.50 9.68 2.02 1.81 0.00 0.00 0.00 0.00 04:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:39:01 AM eth0 9.32 9.60 2.00 1.80 0.00 0.00 0.00 0.00 04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:01 AM eth0 8.88 8.95 1.90 1.70 0.00 0.00 0.00 0.00 04:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:41:01 AM eth0 1.65 0.95 0.45 0.31 0.00 0.00 0.00 0.00 04:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:42:01 AM eth0 6.05 6.13 1.24 1.12 0.00 0.00 0.00 0.00 04:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:43:01 AM eth0 9.58 9.55 2.05 1.78 0.00 0.00 0.00 0.00 04:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:44:01 AM eth0 9.60 9.76 2.03 1.81 0.00 0.00 0.00 0.00 04:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:45:01 AM eth0 9.30 9.57 2.05 1.83 0.00 0.00 0.00 0.00 04:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:46:01 AM eth0 9.41 9.56 1.99 1.78 0.00 0.00 0.00 0.00 04:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:47:01 AM eth0 9.62 9.77 2.08 1.81 0.00 0.00 0.00 0.00 04:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:48:01 AM eth0 6.38 6.43 1.32 1.19 0.00 0.00 0.00 0.00 04:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:49:01 AM eth0 2.62 2.15 0.46 0.39 0.00 0.00 0.00 0.00 04:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:50:01 AM eth0 8.30 8.42 1.83 1.59 0.00 0.00 0.00 0.00 04:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:51:01 AM eth0 9.40 9.60 2.02 1.80 0.00 0.00 0.00 0.00 04:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:52:01 AM eth0 9.00 9.31 1.94 1.74 0.00 0.00 0.00 0.00 04:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:53:01 AM eth0 9.87 9.58 2.06 1.80 0.00 0.00 0.00 0.00 04:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:54:01 AM eth0 9.11 9.01 2.12 1.83 0.00 0.00 0.00 0.00 04:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:55:01 AM eth0 10.46 10.50 2.22 8.42 0.00 0.00 0.00 0.00 04:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:56:01 AM eth0 15.21 15.38 3.43 2.83 0.00 0.00 0.00 0.00 04:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:57:01 AM eth0 0.48 0.40 0.10 0.06 0.00 0.00 0.00 0.00 04:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:58:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:59:01 AM eth0 0.42 0.37 0.07 0.05 0.00 0.00 0.00 0.00 05:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:00:01 AM eth0 1.22 1.45 0.15 6.43 0.00 0.00 0.00 0.00 05:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:01:01 AM eth0 0.43 0.32 0.07 0.04 0.00 0.00 0.00 0.00 05:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:02:01 AM eth0 0.67 0.05 0.10 0.00 0.00 0.00 0.00 0.00 05:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:03:01 AM eth0 2.95 2.88 0.69 0.54 0.00 0.00 0.00 0.00 05:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:04:01 AM eth0 7.48 7.38 1.47 0.63 0.00 0.00 0.00 0.00 05:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:05:01 AM eth0 1.60 2.28 0.21 6.68 0.00 0.00 0.00 0.00 05:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:06:01 AM eth0 0.30 0.10 0.01 0.00 0.00 0.00 0.00 0.00 05:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:07:01 AM eth0 2.35 2.27 0.53 0.17 0.00 0.00 0.00 0.00 05:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:08:01 AM eth0 4.90 4.43 1.11 0.42 0.00 0.00 0.00 0.00 05:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:09:01 AM eth0 3.65 3.56 0.67 0.29 0.00 0.00 0.00 0.00 05:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:10:01 AM eth0 3.13 4.07 0.69 5.02 0.00 0.00 0.00 0.00 05:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:11:01 AM eth0 0.32 0.25 0.03 0.03 0.00 0.00 0.00 0.00 05:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:12:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 05:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:13:01 AM eth0 7.73 7.80 1.37 0.85 0.00 0.00 0.00 0.00 05:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:14:01 AM eth0 10.25 10.58 2.19 1.97 0.00 0.00 0.00 0.00 05:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:15:01 AM eth0 9.88 9.76 2.18 1.87 0.00 0.00 0.00 0.00 05:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:16:01 AM eth0 9.47 9.63 2.02 1.81 0.00 0.00 0.00 0.00 05:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:17:01 AM eth0 9.18 9.31 1.95 1.74 0.00 0.00 0.00 0.00 05:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:18:01 AM eth0 10.01 9.62 2.09 1.80 0.00 0.00 0.00 0.00 05:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:19:01 AM eth0 10.30 9.75 2.62 2.13 0.00 0.00 0.00 0.00 05:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:20:01 AM eth0 13.18 12.96 3.03 2.42 0.00 0.00 0.00 0.00 05:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:21:01 AM eth0 1.22 0.72 0.28 0.14 0.00 0.00 0.00 0.00 05:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:22:01 AM eth0 0.62 0.60 0.18 0.13 0.00 0.00 0.00 0.00 05:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:23:01 AM eth0 0.72 0.60 0.19 0.13 0.00 0.00 0.00 0.00 05:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:24:01 AM eth0 0.82 0.68 0.25 0.13 0.00 0.00 0.00 0.00 05:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:25:01 AM eth0 0.78 0.72 0.26 0.20 0.00 0.00 0.00 0.00 05:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:26:01 AM eth0 8.35 8.52 1.64 1.04 0.00 0.00 0.00 0.00 05:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:27:01 AM eth0 4.32 4.30 0.70 0.37 0.00 0.00 0.00 0.00 05:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:28:01 AM eth0 4.48 4.43 0.85 0.40 0.00 0.00 0.00 0.00 05:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:29:01 AM eth0 1.55 1.50 0.31 0.16 0.00 0.00 0.00 0.00 05:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:30:01 AM eth0 4.98 4.87 0.80 0.50 0.00 0.00 0.00 0.00 05:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:31:01 AM eth0 4.72 4.65 0.87 0.61 0.00 0.00 0.00 0.00 05:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:32:01 AM eth0 6.85 6.90 1.61 1.43 0.00 0.00 0.00 0.00 05:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:33:01 AM eth0 9.35 9.63 2.02 1.81 0.00 0.00 0.00 0.00 05:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:34:01 AM eth0 9.98 9.56 2.06 1.79 0.00 0.00 0.00 0.00 05:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:35:01 AM eth0 10.45 9.90 2.76 2.20 0.00 0.00 0.00 0.00 05:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:36:01 AM eth0 9.46 9.68 2.02 1.81 0.00 0.00 0.00 0.00 05:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:37:01 AM eth0 9.37 9.72 2.02 1.81 0.00 0.00 0.00 0.00 05:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:38:01 AM eth0 17.36 17.30 3.90 3.21 0.00 0.00 0.00 0.00 05:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:39:01 AM eth0 0.57 0.45 0.10 0.06 0.00 0.00 0.00 0.00 05:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:40:01 AM eth0 0.33 0.10 0.08 0.06 0.00 0.00 0.00 0.00 05:41:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:41:02 AM eth0 0.50 0.35 0.08 0.05 0.00 0.00 0.00 0.00 05:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:42:01 AM eth0 0.10 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:43:01 AM eth0 0.12 0.03 0.01 0.00 0.00 0.00 0.00 0.00 05:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:44:01 AM eth0 0.37 0.28 0.07 0.04 0.00 0.00 0.00 0.00 05:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:45:01 AM eth0 0.35 0.12 0.09 0.07 0.00 0.00 0.00 0.00 05:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:46:01 AM eth0 7.48 7.50 1.54 0.96 0.00 0.00 0.00 0.00 05:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:47:01 AM eth0 3.02 2.90 0.65 0.25 0.00 0.00 0.00 0.00 05:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:48:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 05:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:49:01 AM eth0 2.75 2.67 0.47 0.26 0.00 0.00 0.00 0.00 05:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:50:01 AM eth0 0.53 0.48 0.13 0.13 0.00 0.00 0.00 0.00 05:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:51:01 AM eth0 2.85 2.78 0.55 0.20 0.00 0.00 0.00 0.00 05:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:52:01 AM eth0 0.50 0.43 0.07 0.09 0.00 0.00 0.00 0.00 05:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:53:01 AM eth0 0.20 0.00 0.01 0.00 0.00 0.00 0.00 0.00 05:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:54:01 AM eth0 6.73 6.82 1.27 0.74 0.00 0.00 0.00 0.00 05:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:55:01 AM eth0 9.50 9.80 2.07 1.87 0.00 0.00 0.00 0.00 05:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:56:01 AM eth0 9.05 9.28 1.94 1.74 0.00 0.00 0.00 0.00 05:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:57:01 AM eth0 9.53 9.72 2.13 1.81 0.00 0.00 0.00 0.00 05:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:58:01 AM eth0 9.48 9.65 2.02 1.81 0.00 0.00 0.00 0.00 05:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:59:01 AM eth0 9.40 9.70 2.02 1.81 0.00 0.00 0.00 0.00 06:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:00:01 AM eth0 9.23 9.40 2.03 1.80 0.00 0.00 0.00 0.00 06:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:01:01 AM eth0 15.29 15.21 3.48 2.79 0.00 0.00 0.00 0.00 06:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:02:01 AM eth0 0.57 0.42 0.09 0.07 0.00 0.00 0.00 0.00 06:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:03:01 AM eth0 0.15 0.00 0.01 0.00 0.00 0.00 0.00 0.00 06:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:04:01 AM eth0 0.43 0.32 0.07 0.04 0.00 0.00 0.00 0.00 06:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:05:01 AM eth0 0.32 0.18 0.09 0.07 0.00 0.00 0.00 0.00 06:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:06:01 AM eth0 0.60 0.42 0.13 0.05 0.00 0.00 0.00 0.00 06:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:07:01 AM eth0 0.07 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:08:01 AM eth0 2.90 2.88 0.64 0.53 0.00 0.00 0.00 0.00 06:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:09:01 AM eth0 7.82 7.87 1.52 1.05 0.00 0.00 0.00 0.00 06:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:10:01 AM eth0 8.65 8.45 2.02 1.08 0.00 0.00 0.00 0.00 06:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:11:01 AM eth0 6.28 6.32 1.26 0.79 0.00 0.00 0.00 0.00 06:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:12:01 AM eth0 7.31 7.36 3.27 0.89 0.00 0.00 0.00 0.00 06:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:13:01 AM eth0 6.97 6.92 1.57 0.97 0.00 0.00 0.00 0.00 06:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:14:01 AM eth0 8.32 8.20 1.47 0.98 0.00 0.00 0.00 0.00 06:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:15:01 AM eth0 6.78 6.73 3.37 0.99 0.00 0.00 0.00 0.00 06:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 06:16:01 AM eth0 118.51 82.41 255.48 296.39 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 8.33 6.89 9.03 2.25 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-553.5.1.el8.x86_64 (centos-stream-8-robot-7d7a37eb-bc14-4dd6-9530-dc22c5eae738.noval) 08/18/2024 _x86_64_ (2 CPU) 00:23:15 LINUX RESTART (2 CPU) 12:24:01 AM CPU %user %nice %system %iowait %steal %idle 12:25:01 AM all 38.32 0.04 6.89 14.36 0.14 40.25 12:25:01 AM 0 41.01 0.03 7.00 15.38 0.15 36.42 12:25:01 AM 1 35.63 0.05 6.78 13.34 0.12 44.08 12:26:01 AM all 30.02 0.00 5.08 4.02 0.14 60.73 12:26:01 AM 0 41.37 0.00 6.32 4.70 0.13 47.47 12:26:01 AM 1 18.70 0.00 3.84 3.34 0.15 73.96 12:27:01 AM all 11.15 0.00 1.37 8.27 0.04 79.17 12:27:01 AM 0 20.06 0.00 1.75 11.71 0.05 66.43 12:27:01 AM 1 2.22 0.00 0.99 4.83 0.03 91.92 12:28:01 AM all 19.37 0.00 3.24 0.59 0.08 76.71 12:28:01 AM 0 16.06 0.00 3.18 0.47 0.07 80.22 12:28:01 AM 1 22.67 0.00 3.31 0.72 0.10 73.20 12:29:01 AM all 12.57 0.00 3.50 6.45 0.11 77.36 12:29:01 AM 0 10.77 0.00 3.16 6.23 0.08 79.76 12:29:01 AM 1 14.38 0.00 3.85 6.67 0.14 74.95 12:30:01 AM all 1.31 0.00 0.28 0.03 0.03 98.35 12:30:01 AM 0 0.47 0.00 0.32 0.00 0.02 99.20 12:30:01 AM 1 2.16 0.00 0.25 0.05 0.03 97.50 12:31:01 AM all 5.16 0.00 0.40 0.26 0.06 94.12 12:31:01 AM 0 8.77 0.00 0.54 0.00 0.07 90.63 12:31:01 AM 1 1.57 0.00 0.27 0.52 0.05 97.59 12:32:01 AM all 4.27 0.00 0.28 0.00 0.06 95.38 12:32:01 AM 0 6.32 0.00 0.37 0.00 0.07 93.24 12:32:01 AM 1 2.23 0.00 0.20 0.00 0.05 97.52 12:33:01 AM all 4.21 0.00 0.30 0.00 0.07 95.42 12:33:01 AM 0 6.27 0.00 0.42 0.00 0.07 93.24 12:33:01 AM 1 2.14 0.00 0.18 0.00 0.07 97.61 12:34:01 AM all 3.95 0.00 0.31 0.00 0.06 95.68 12:34:01 AM 0 4.25 0.00 0.30 0.00 0.05 95.40 12:34:01 AM 1 3.64 0.00 0.32 0.00 0.07 95.97 12:35:01 AM all 4.25 0.00 0.28 0.00 0.06 95.41 12:35:01 AM 0 5.42 0.00 0.35 0.00 0.07 94.16 12:35:01 AM 1 3.08 0.00 0.22 0.00 0.05 96.65 12:35:01 AM CPU %user %nice %system %iowait %steal %idle 12:36:01 AM all 4.27 0.00 0.32 0.00 0.07 95.35 12:36:01 AM 0 4.15 0.00 0.30 0.00 0.07 95.48 12:36:01 AM 1 4.38 0.00 0.33 0.00 0.07 95.22 12:37:01 AM all 5.70 0.00 0.33 0.00 0.07 93.90 12:37:01 AM 0 6.44 0.00 0.28 0.00 0.05 93.22 12:37:01 AM 1 4.96 0.00 0.39 0.00 0.08 94.58 12:38:01 AM all 0.63 0.00 0.07 0.00 0.05 99.26 12:38:01 AM 0 0.73 0.00 0.08 0.00 0.05 99.13 12:38:01 AM 1 0.52 0.00 0.05 0.00 0.05 99.38 12:39:01 AM all 0.38 0.00 0.21 0.00 0.03 99.38 12:39:01 AM 0 0.50 0.00 0.15 0.00 0.03 99.32 12:39:01 AM 1 0.25 0.00 0.27 0.00 0.03 99.45 12:40:01 AM all 0.59 0.00 0.09 0.03 0.04 99.24 12:40:01 AM 0 0.57 0.00 0.10 0.03 0.03 99.27 12:40:01 AM 1 0.62 0.00 0.08 0.03 0.05 99.22 12:41:01 AM all 0.33 0.00 0.08 0.00 0.03 99.56 12:41:01 AM 0 0.15 0.00 0.10 0.00 0.05 99.70 12:41:01 AM 1 0.50 0.00 0.07 0.00 0.02 99.42 12:42:01 AM all 0.58 0.00 0.10 0.00 0.03 99.28 12:42:01 AM 0 0.35 0.00 0.12 0.00 0.03 99.50 12:42:01 AM 1 0.82 0.00 0.08 0.00 0.03 99.07 12:43:01 AM all 0.38 0.00 0.07 0.00 0.03 99.53 12:43:01 AM 0 0.65 0.00 0.07 0.00 0.03 99.25 12:43:01 AM 1 0.10 0.00 0.07 0.00 0.02 99.82 12:44:01 AM all 0.42 0.00 0.09 0.00 0.03 99.46 12:44:01 AM 0 0.45 0.00 0.07 0.00 0.02 99.47 12:44:01 AM 1 0.38 0.00 0.12 0.00 0.05 99.45 12:45:01 AM all 7.12 0.00 2.59 0.00 0.07 90.22 12:45:01 AM 0 12.02 0.00 5.05 0.00 0.07 82.85 12:45:01 AM 1 2.51 0.00 0.27 0.00 0.07 97.16 12:46:01 AM all 7.03 0.00 2.00 0.00 0.06 90.91 12:46:01 AM 0 13.98 0.00 4.08 0.00 0.07 81.86 12:46:01 AM 1 0.60 0.00 0.08 0.00 0.05 99.27 12:46:01 AM CPU %user %nice %system %iowait %steal %idle 12:47:01 AM all 2.45 0.00 1.13 0.00 0.06 96.36 12:47:01 AM 0 4.47 0.00 2.14 0.00 0.05 93.34 12:47:01 AM 1 0.50 0.00 0.15 0.00 0.07 99.28 12:48:01 AM all 0.37 0.00 0.07 0.00 0.03 99.53 12:48:01 AM 0 0.57 0.00 0.07 0.00 0.03 99.33 12:48:01 AM 1 0.17 0.00 0.07 0.00 0.03 99.73 12:49:01 AM all 4.05 0.00 1.86 0.00 0.05 94.03 12:49:01 AM 0 3.83 0.00 3.32 0.00 0.03 92.81 12:49:01 AM 1 4.28 0.00 0.38 0.00 0.07 95.27 12:50:01 AM all 1.15 0.00 0.12 0.00 0.03 98.70 12:50:01 AM 0 2.12 0.00 0.13 0.00 0.02 97.73 12:50:01 AM 1 0.18 0.00 0.10 0.00 0.05 99.67 12:51:01 AM all 0.34 0.00 0.07 0.00 0.03 99.56 12:51:01 AM 0 0.58 0.00 0.05 0.00 0.03 99.33 12:51:01 AM 1 0.10 0.00 0.08 0.00 0.03 99.78 12:52:01 AM all 4.87 0.00 1.34 0.00 0.06 93.73 12:52:01 AM 0 9.77 0.00 2.57 0.00 0.07 87.60 12:52:01 AM 1 0.23 0.00 0.18 0.00 0.05 99.53 12:53:01 AM all 0.44 0.00 0.08 0.00 0.03 99.45 12:53:01 AM 0 0.73 0.00 0.08 0.00 0.03 99.15 12:53:01 AM 1 0.15 0.00 0.07 0.00 0.03 99.75 12:54:01 AM all 0.72 0.00 0.13 0.00 0.03 99.12 12:54:01 AM 0 0.54 0.00 0.15 0.00 0.03 99.28 12:54:01 AM 1 0.91 0.00 0.10 0.00 0.03 98.96 12:55:01 AM all 4.22 0.00 1.81 0.00 0.06 93.91 12:55:01 AM 0 0.53 0.00 0.12 0.00 0.05 99.30 12:55:01 AM 1 8.09 0.00 3.58 0.00 0.07 88.25 12:56:01 AM all 0.38 0.00 0.07 0.00 0.04 99.51 12:56:01 AM 0 0.65 0.00 0.05 0.00 0.03 99.27 12:56:01 AM 1 0.12 0.00 0.08 0.00 0.05 99.75 12:57:01 AM all 2.41 0.00 0.21 0.00 0.04 97.33 12:57:01 AM 0 0.63 0.00 0.08 0.00 0.05 99.23 12:57:01 AM 1 4.23 0.00 0.34 0.00 0.03 95.39 12:57:01 AM CPU %user %nice %system %iowait %steal %idle 12:58:01 AM all 2.77 0.00 1.44 0.00 0.05 95.74 12:58:01 AM 0 0.22 0.00 0.15 0.00 0.07 99.57 12:58:01 AM 1 5.40 0.00 2.78 0.00 0.03 91.79 12:59:01 AM all 0.35 0.00 0.07 0.00 0.03 99.55 12:59:01 AM 0 0.47 0.00 0.07 0.00 0.03 99.43 12:59:01 AM 1 0.23 0.00 0.07 0.00 0.03 99.67 01:00:01 AM all 3.93 0.00 1.84 0.00 0.05 94.17 01:00:01 AM 0 7.51 0.00 3.61 0.00 0.05 88.82 01:00:01 AM 1 0.47 0.00 0.13 0.00 0.05 99.35 01:01:01 AM all 1.33 0.00 0.15 0.00 0.04 98.47 01:01:01 AM 0 2.09 0.00 0.22 0.00 0.05 97.64 01:01:01 AM 1 0.58 0.00 0.08 0.00 0.03 99.30 01:02:01 AM all 0.43 0.00 0.13 0.01 0.03 99.40 01:02:01 AM 0 0.53 0.00 0.13 0.00 0.03 99.30 01:02:01 AM 1 0.33 0.00 0.12 0.02 0.03 99.50 01:03:01 AM all 4.71 0.00 1.32 0.00 0.05 93.93 01:03:01 AM 0 0.63 0.00 0.12 0.00 0.05 99.20 01:03:01 AM 1 9.04 0.00 2.59 0.00 0.05 88.32 01:04:01 AM all 0.32 0.00 0.10 0.01 0.03 99.55 01:04:01 AM 0 0.57 0.00 0.13 0.02 0.03 99.25 01:04:01 AM 1 0.07 0.00 0.07 0.00 0.02 99.85 01:05:01 AM all 0.38 0.00 0.11 0.00 0.04 99.47 01:05:01 AM 0 0.50 0.00 0.13 0.00 0.05 99.31 01:05:01 AM 1 0.25 0.00 0.08 0.00 0.03 99.63 01:06:01 AM all 4.46 0.24 2.01 0.09 0.05 93.15 01:06:01 AM 0 8.91 0.33 3.88 0.10 0.05 86.72 01:06:01 AM 1 0.20 0.15 0.22 0.08 0.05 99.30 01:07:01 AM all 0.38 0.00 0.07 0.02 0.04 99.50 01:07:01 AM 0 0.60 0.00 0.05 0.00 0.03 99.32 01:07:01 AM 1 0.15 0.00 0.08 0.03 0.05 99.68 01:08:01 AM all 0.38 0.00 0.07 0.00 0.03 99.52 01:08:01 AM 0 0.55 0.00 0.02 0.00 0.00 99.43 01:08:01 AM 1 0.22 0.00 0.12 0.00 0.05 99.62 01:08:01 AM CPU %user %nice %system %iowait %steal %idle 01:09:01 AM all 0.35 0.00 0.08 0.00 0.04 99.52 01:09:01 AM 0 0.35 0.00 0.05 0.00 0.03 99.57 01:09:01 AM 1 0.35 0.00 0.12 0.00 0.05 99.48 01:10:01 AM all 0.28 0.00 0.09 0.00 0.04 99.59 01:10:01 AM 0 0.10 0.00 0.07 0.00 0.03 99.80 01:10:01 AM 1 0.45 0.00 0.12 0.00 0.05 99.38 01:11:01 AM all 0.34 0.00 0.08 0.00 0.04 99.53 01:11:01 AM 0 0.52 0.00 0.07 0.00 0.03 99.38 01:11:01 AM 1 0.17 0.00 0.10 0.00 0.05 99.68 01:12:01 AM all 0.28 0.01 0.12 0.01 0.04 99.54 01:12:01 AM 0 0.42 0.02 0.15 0.02 0.03 99.37 01:12:01 AM 1 0.15 0.00 0.08 0.00 0.05 99.72 01:13:01 AM all 0.34 0.00 0.06 0.01 0.03 99.56 01:13:01 AM 0 0.50 0.00 0.02 0.02 0.02 99.45 01:13:01 AM 1 0.18 0.00 0.10 0.00 0.05 99.67 01:14:01 AM all 6.19 0.00 2.32 0.00 0.08 91.41 01:14:01 AM 0 12.49 0.00 4.64 0.00 0.07 82.80 01:14:01 AM 1 0.35 0.00 0.17 0.00 0.08 99.40 01:15:01 AM all 4.90 0.00 0.35 0.00 0.08 94.67 01:15:01 AM 0 8.30 0.00 0.52 0.00 0.08 91.09 01:15:01 AM 1 1.51 0.00 0.18 0.00 0.07 98.24 01:16:01 AM all 4.42 0.00 0.30 0.00 0.06 95.22 01:16:01 AM 0 5.66 0.00 0.37 0.00 0.07 93.91 01:16:01 AM 1 3.18 0.00 0.23 0.00 0.05 96.54 01:17:01 AM all 4.30 0.00 0.29 0.00 0.06 95.35 01:17:01 AM 0 5.98 0.00 0.33 0.00 0.07 93.62 01:17:01 AM 1 2.62 0.00 0.25 0.00 0.05 97.07 01:18:01 AM all 4.28 0.00 0.31 0.00 0.07 95.35 01:18:01 AM 0 4.78 0.00 0.36 0.00 0.07 94.80 01:18:01 AM 1 3.78 0.00 0.26 0.00 0.07 95.90 01:19:01 AM all 4.16 0.00 0.32 0.00 0.07 95.46 01:19:01 AM 0 4.52 0.00 0.33 0.00 0.07 95.08 01:19:01 AM 1 3.80 0.00 0.30 0.00 0.07 95.83 01:19:01 AM CPU %user %nice %system %iowait %steal %idle 01:20:01 AM all 4.26 0.00 0.33 0.00 0.07 95.34 01:20:01 AM 0 2.34 0.00 0.23 0.00 0.05 97.37 01:20:01 AM 1 6.18 0.00 0.44 0.00 0.08 93.30 01:21:01 AM all 5.13 0.00 0.32 0.01 0.06 94.49 01:21:01 AM 0 7.55 0.00 0.39 0.00 0.07 91.99 01:21:01 AM 1 2.71 0.00 0.25 0.02 0.05 96.97 01:22:01 AM all 0.48 0.00 0.07 0.00 0.03 99.42 01:22:01 AM 0 0.58 0.00 0.08 0.00 0.03 99.30 01:22:01 AM 1 0.38 0.00 0.05 0.00 0.03 99.53 01:23:01 AM all 0.21 0.00 0.08 0.00 0.03 99.68 01:23:01 AM 0 0.13 0.00 0.08 0.00 0.05 99.73 01:23:01 AM 1 0.28 0.00 0.08 0.00 0.00 99.63 01:24:01 AM all 0.33 0.00 0.08 0.00 0.04 99.56 01:24:01 AM 0 0.45 0.00 0.07 0.00 0.03 99.45 01:24:01 AM 1 0.20 0.00 0.08 0.00 0.05 99.66 01:25:01 AM all 0.34 0.00 0.07 0.00 0.03 99.56 01:25:01 AM 0 0.17 0.00 0.10 0.00 0.03 99.70 01:25:01 AM 1 0.52 0.00 0.03 0.00 0.03 99.42 01:26:01 AM all 0.53 0.00 0.07 0.00 0.03 99.37 01:26:01 AM 0 0.63 0.00 0.07 0.00 0.03 99.27 01:26:01 AM 1 0.42 0.00 0.07 0.00 0.03 99.48 01:27:01 AM all 0.33 0.00 0.05 0.00 0.03 99.59 01:27:01 AM 0 0.60 0.00 0.05 0.00 0.03 99.32 01:27:01 AM 1 0.07 0.00 0.05 0.00 0.02 99.87 01:28:01 AM all 2.85 0.00 0.24 0.00 0.05 96.86 01:28:01 AM 0 5.07 0.00 0.34 0.00 0.07 94.52 01:28:01 AM 1 0.67 0.00 0.13 0.00 0.03 99.16 01:29:01 AM all 7.01 0.00 2.60 0.00 0.10 90.29 01:29:01 AM 0 13.96 0.00 5.24 0.00 0.11 80.69 01:29:01 AM 1 0.67 0.00 0.18 0.00 0.08 99.07 01:30:01 AM all 2.26 0.00 1.55 0.00 0.05 96.14