Started by upstream project "integration-distribution-mri-test-potassium" build number 39 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-7771 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-ask-all-potassium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-oTdaCVXeXZQk/agent.5285 SSH_AGENT_PID=5286 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-ask-all-potassium@tmp/private_key_975684449280051943.key (/w/workspace/controller-csit-3node-clustering-ask-all-potassium@tmp/private_key_975684449280051943.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test@tmp/jenkins-gitclient-ssh7095706959783684459.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test@tmp/jenkins-gitclient-ssh7011498620750423732.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 02dd570f7544c8cd6eb17bda775de9bccc89f923 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 02dd570f7544c8cd6eb17bda775de9bccc89f923 # timeout=10 Commit message: "Migrate Get Requests invocations(libraries)" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk c88ead2b4a65ba004398ad07cfe033ae1e467b17 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins7718222096617563860.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-6BvC lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH Generating Requirements File Python 3.11.7 pip 24.0 from /tmp/venv-6BvC/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.2.3 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.34.84 botocore==1.34.84 bs4==0.0.2 cachetools==5.3.3 certifi==2024.2.2 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.6.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.6.1 docker==4.2.2 dogpile.cache==1.3.2 email_validator==2.1.1 filelock==3.13.4 future==1.0.0 gitdb==4.0.11 GitPython==3.1.43 google-auth==2.29.0 httplib2==0.22.0 identify==2.5.35 idna==3.7 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.3 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.21.1 jsonschema-specifications==2023.12.1 keystoneauth1==5.6.0 kubernetes==29.0.0 lftools==0.37.10 lxml==5.2.1 MarkupSafe==2.1.5 msgpack==1.0.8 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.2.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==3.0.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.0.1 oslo.config==9.4.0 oslo.context==5.5.0 oslo.i18n==6.3.0 oslo.log==5.5.1 oslo.serialization==5.4.0 oslo.utils==7.1.0 packaging==24.0 pbr==6.0.0 platformdirs==4.2.0 prettytable==3.10.0 pyasn1==0.6.0 pyasn1_modules==0.4.0 pycparser==2.22 pygerrit2==2.0.15 PyGithub==2.3.0 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.5.0 python-dateutil==2.9.0.post0 python-heatclient==3.5.0 python-jenkins==1.8.2 python-keystoneclient==5.4.0 python-magnumclient==4.4.0 python-novaclient==18.6.0 python-openstackclient==6.6.0 python-swiftclient==4.5.0 PyYAML==6.0.1 referencing==0.34.0 requests==2.31.0 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.18.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.1 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.2.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.4 tqdm==4.66.2 typing_extensions==4.11.0 tzdata==2024.1 urllib3==1.26.18 virtualenv==20.25.1 wcwidth==0.2.13 websocket-client==1.7.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.3.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-potassium-39 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins16145799489720158770.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - CentOS Stream 8 - builder - x86_64 - 20240401-160147.446' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - 20230601-180106.003' job_name: '29108-39' silo: 'releng' [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins17748849323837589559.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-v5qc + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ sort -V +++ tail -n 1 ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-6BvC + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from file:/tmp/.os_lf_venv + /tmp/venv-6BvC/bin/python3 -m pip install --upgrade --quiet pip virtualenv + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ]] + echo 'lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq ' lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + /tmp/venv-6BvC/bin/python3 -m pip install --upgrade --quiet --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH + PATH=/tmp/venv-6BvC/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 352256 | | totalCoresUsed | 86 | | totalInstancesUsed | 30 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-ask-all-potassium + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-ask-all-potassium-39 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-ask-all-potassium/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-ask-all-potassium-39 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2024-04-14T12:11:24Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': 'c3f09d2b-68ff-4767-b970-3f7bc154913f', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-ask-all-potassium-39/c3f09d2b-68ff-4767-b970-3f7bc154913f', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-ask-all-potassium-39', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}, {'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.170.28', '10.30.171.37', '10.30.171.13']}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': 'c3f09d2b-68ff-4767-b970-3f7bc154913f', 'OS::stack_name': 'releng-controller-csit-3node-clustering-ask-all-potassium-39', 'job_name': '29108-39', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - CentOS Stream 8 - builder - x86_64 - ' '20240401-160147.446', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 18.04 - mininet-ovs-28 - x86_64 - ' '20230601-180106.003'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': '67604489a221450b866bedb4c83e91b7'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-ask-all-potassium [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins135782937291136040.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH SSH not responding on 10.30.170.28. Retrying in 10 seconds... SSH not responding on 10.30.171.13. Retrying in 10 seconds... SSH not responding on 10.30.171.37. Retrying in 10 seconds... Ping to 10.30.171.37 successful. Ping to 10.30.170.28 successful. Ping to 10.30.171.13 successful. SSH not responding on 10.30.171.13. Retrying in 10 seconds... SSH not responding on 10.30.171.37. Retrying in 10 seconds... Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. 10.30.170.28 releng-29108-39-0-builder-0.novalocal Successfully copied public keys to slave 10.30.170.28 Process 6710 ready. Ping to 10.30.171.13 successful. Ping to 10.30.171.37 successful. SSH not responding on 10.30.171.37. Retrying in 10 seconds... Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. 10.30.171.13 releng-29108-39-0-builder-2.novalocal Successfully copied public keys to slave 10.30.171.13 Ping to 10.30.171.37 successful. Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. 10.30.171.37 releng-29108-39-0-builder-1.novalocal Successfully copied public keys to slave 10.30.171.37 Process 6711 ready. Process 6712 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins3712174801550257093.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-J2Hb lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.robot_venv lf-activate-venv(): INFO: Installing: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-J2Hb/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.0/50.0 kB 6.6 MB/s eta 0:00:00 Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.2.1/netaddr-1.2.1-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Using cached netifaces-0.11.0-cp311-cp311-linux_x86_64.whl Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.60/pyhocon-0.3.60.tar.gz (158 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.8/158.8 kB 17.5 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.31.0/requests-2.31.0-py3-none-any.whl (62 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.0/robotframework-7.0-py3-none-any.whl (726 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 726.3/726.3 kB 16.9 MB/s eta 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.3 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.3/robotframework_requests-0.9.3-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.4/51.4 kB 6.8 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.5.0/scapy-2.5.0.tar.gz (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 29.5 MB/s eta 0:00:00 Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.13.0/elasticsearch-8.13.0-py3-none-any.whl (451 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 451.0/451.0 kB 14.5 MB/s eta 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.13.0/elasticsearch_dsl-8.13.0-py3-none-any.whl (88 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.6/88.6 kB 14.3 MB/s eta 0:00:00 Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.5/pyangbind-0.8.5-py3-none-any.whl (52 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.9/52.9 kB 7.7 MB/s eta 0:00:00 Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.6.1/isodate-0.6.1-py2.py3-none-any.whl (41 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.7/41.7 kB 5.1 MB/s eta 0:00:00 Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/3.4.0/paramiko-3.4.0-py3-none-any.whl (225 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 225.9/225.9 kB 29.4 MB/s eta 0:00:00 Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.14.5/scp-0.14.5-py2.py3-none-any.whl (8.7 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.16.0/six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.7.0/websocket_client-1.7.0-py3-none-any.whl (58 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.1.2/pyparsing-3.1.2-py3-none-any.whl (103 kB) Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.3.2/charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.7/idna-3.7-py3-none-any.whl (66 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.2.1/urllib3-2.2.1-py3-none-any.whl (121 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.1/121.1 kB 4.3 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2024.2.2/certifi-2024.2.2-py3-none-any.whl (163 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.0/WebTest-3.0.0-py3-none-any.whl (31 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/2.4/jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.2.0/robotframework_seleniumlibrary-6.2.0-py2.py3-none-any.whl (95 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.5/95.5 kB 2.8 MB/s eta 0:00:00 Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 kB 8.4 MB/s eta 0:00:00 Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.1.1/decorator-5.1.1-py3-none-any.whl (9.1 kB) Collecting elastic-transport<9,>=8.13 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.13.0/elastic_transport-8.13.0-py3-none-any.whl (64 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 9.4 MB/s eta 0:00:00 Collecting python-dateutil (from elasticsearch-dsl->-r requirements.txt (line 19)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.6.0/pyang-2.6.0-py2.py3-none-any.whl (594 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 594.1/594.1 kB 15.9 MB/s eta 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/5.2.1/lxml-5.2.1-cp311-cp311-manylinux_2_28_x86_64.whl (5.0 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2023.12.25/regex-2023.12.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 17.8 MB/s eta 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/4.1.2/bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 45.0 MB/s eta 0:00:00 Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/42.0.5/cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.5.0/PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.19.0/selenium-4.19.0-py3-none-any.whl (10.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.5/10.5 MB 52.4 MB/s eta 0:00:00 Collecting robotframework-pythonlibcore>=3.0.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.7/WebOb-1.8.7-py2.py3-none-any.whl (114 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 115.0/115.0 kB 17.9 MB/s eta 0:00:00 Collecting waitress>=0.8.5 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.0/waitress-3.0.0-py3-none-any.whl (56 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.7/56.7 kB 7.5 MB/s eta 0:00:00 Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.12.3/beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) Collecting cffi>=1.12 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/1.16.0/cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) Collecting trio~=0.17 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.25.0/trio-0.25.0-py3-none-any.whl (467 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.2/467.2 kB 17.1 MB/s eta 0:00:00 Collecting trio-websocket~=0.9 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.11.1/trio_websocket-0.11.1-py3-none-any.whl (17 kB) Collecting typing_extensions>=4.9.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.11.0/typing_extensions-4.11.0-py3-none-any.whl (34 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.5/soupsieve-2.5-py3-none-any.whl (36 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.22/pycparser-2.22-py3-none-any.whl (117 kB) Collecting attrs>=23.2.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/23.2.0/attrs-23.2.0-py3-none-any.whl (60 kB) Collecting sortedcontainers (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio~=0.17->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3,>=1.26->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket~=0.9->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.14.0/h11-0.14.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 8.5 MB/s eta 0:00:00 Building wheels for collected packages: robotframework-sshlibrary, ipaddr, pyhocon, robotframework-httplibrary, scapy, jsonpath-rw Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55119 sha256=6e638ff4dd00788a7a69d43e299a46c64125d67985491835633a88bc216d2aa8 Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18280 sha256=bb063a6033782d10e6a82e0aa51112b5552bdea70d1f41634ef95e3c15bc9345 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf Building wheel for pyhocon (setup.py): started Building wheel for pyhocon (setup.py): finished with status 'done' Created wheel for pyhocon: filename=pyhocon-0.3.60-py3-none-any.whl size=20865 sha256=a5011c61c6c460d61b46c66656d939df98efd6a9744f62d6ef9e4853ea120a9d Stored in directory: /home/jenkins/.cache/pip/wheels/02/09/4e/04a983205b51f96912ae6fc13f56f3050a586c98200fe36725 Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=9953 sha256=14442f227e7c9d91feaf5a4b52794102c655090cbcbe70e2a5035d58786dccb3 Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed Building wheel for scapy (setup.py): started Building wheel for scapy (setup.py): finished with status 'done' Created wheel for scapy: filename=scapy-2.5.0-py2.py3-none-any.whl size=1444327 sha256=d9e26954bd77e4598e700c3f530d157efddb6be5d24fc028f0c550af6924d653 Stored in directory: /home/jenkins/.cache/pip/wheels/3b/a7/d6/87eeec31fbfcb2bd8ace7dad8172b6d6ebbe1ec6827dbb389a Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15130 sha256=7601f9b98204a90865a7cd5767b95a5e96305a0b7ab84b9cdb26f665ab09d54e Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr pyhocon robotframework-httplibrary scapy jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing_extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, idna, h11, decorator, charset-normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, isodate, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.7 attrs-23.2.0 bcrypt-4.1.2 beautifulsoup4-4.12.3 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cryptography-42.0.5 decorator-5.1.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.13.0 elasticsearch-8.13.0 elasticsearch-dsl-8.13.0 enum34-1.1.10 h11-0.14.0 idna-3.7 ipaddr-2.2.0 isodate-0.6.1 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-2.4 lxml-5.2.1 netaddr-1.2.1 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-3.4.0 ply-3.11 pyang-2.6.0 pyangbind-0.8.5 pycparser-2.22 pyhocon-0.3.60 pynacl-1.5.0 pyparsing-3.1.2 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2023.12.25 requests-2.31.0 robotframework-7.0 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.3 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.2.0 robotframework-sshlibrary-3.8.0 scapy-2.5.0 scp-0.14.5 selenium-4.19.0 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 trio-0.25.0 trio-websocket-0.11.1 typing_extensions-4.11.0 urllib3-2.2.1 waitress-3.0.0 websocket-client-1.7.0 webtest-3.0.0 wsproto-1.2.0 + pip freeze attrs==23.2.0 bcrypt==4.1.2 beautifulsoup4==4.12.3 certifi==2024.2.2 cffi==1.16.0 charset-normalizer==3.3.2 cryptography==42.0.5 decorator==5.1.1 distlib==0.3.8 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.13.0 elasticsearch==8.13.0 elasticsearch-dsl==8.13.0 enum34==1.1.10 filelock==3.13.4 h11==0.14.0 idna==3.7 ipaddr==2.2.0 isodate==0.6.1 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==2.4 lxml==5.2.1 netaddr==1.2.1 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==3.4.0 platformdirs==4.2.0 ply==3.11 pyang==2.6.0 pyangbind==0.8.5 pycparser==2.22 pyhocon==0.3.60 PyNaCl==1.5.0 pyparsing==3.1.2 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2023.12.25 requests==2.31.0 robotframework==7.0 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.4.1 robotframework-requests==0.9.3 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.2.0 robotframework-sshlibrary==3.8.0 scapy==2.5.0 scp==0.14.5 selenium==4.19.0 six==1.16.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.5 trio==0.25.0 trio-websocket==0.11.1 typing_extensions==4.11.0 urllib3==2.2.1 virtualenv==20.25.1 waitress==3.0.0 WebOb==1.8.7 websocket-client==1.7.0 WebTest==3.0.0 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins1577995479827853973.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.10 requires urllib3<2.1.0, but you have urllib3 2.2.1 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-ask-all-potassium-39 + for i in "${ADDR[@]}" ++ ssh 10.30.170.28 hostname -s Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + REMHOST=releng-29108-39-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.37 hostname -s Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + REMHOST=releng-29108-39-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.171.13 hostname -s Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + REMHOST=releng-29108-39-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.170.28 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.170.28 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.171.37 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.171.13 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.170.28 ODL_SYSTEM_1_IP=10.30.170.28 ODL_SYSTEM_2_IP=10.30.171.37 ODL_SYSTEM_3_IP=10.30.171.13 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/sh /tmp/jenkins10249662266765664662.sh Preparing for JRE Version 17 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-17-openjdk [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins16583528792910981453.sh --2024-04-14 12:13:30-- http://git.opendaylight.org/gerrit/gitweb?p=integration/distribution.git;a=blob_plain;f=pom.xml;hb=refs/heads/stable/potassium Resolving git.opendaylight.org (git.opendaylight.org)... 35.181.223.58, 13.39.230.180, 52.47.161.242, ... Connecting to git.opendaylight.org (git.opendaylight.org)|35.181.223.58|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 2620 (2.6K) [text/plain] Saving to: ‘pom.xml’ 0K .. 100% 305M=0s 2024-04-14 12:13:30 (305 MB/s) - ‘pom.xml’ saved [2620/2620] Bundle version is 0.19.3-SNAPSHOT --2024-04-14 12:13:30-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 53.3M=0s 2024-04-14 12:13:31 (53.3 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.19.3-SNAPSHOT 20240414.094318 133 20240414094318 pom 0.19.3-20240414.094318-133 20240414094318 tar.gz 0.19.3-20240414.094318-133 20240414094318 zip 0.19.3-20240414.094318-133 20240414094318 cyclonedx xml 0.19.3-20240414.094318-133 20240414094318 cyclonedx json 0.19.3-20240414.094318-133 20240414094318 Nexus timestamp is 0.19.3-20240414.094318-133 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip Distribution bundle is karaf-0.19.3-20240414.094318-133.zip Distribution bundle version is 0.19.3-SNAPSHOT Distribution folder is karaf-0.19.3-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins5849041412098488052.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.170.28:/tmp Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.37:/tmp Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.171.13:/tmp Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins2098795561242428067.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.170.28 Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.171.37 Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.171.13 Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.170.28 Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. common-functions.sh is being sourced + source /tmp/common-functions.sh karaf-0.19.3-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.19.3-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip --2024-04-14 12:13:42-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 234135179 (223M) [application/zip] Saving to: ‘karaf-0.19.3-20240414.094318-133.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 71.9M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 117M 2s 6144K ........ ........ ........ ........ ........ ........ 4% 177M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 167M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 170M 2s 15360K ........ ........ ........ ........ ........ ........ 8% 209M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 211M 1s 21504K ........ ........ ........ ........ ........ ........ 10% 252M 1s 24576K ........ ........ ........ ........ ........ ........ 12% 260M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 205M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 275M 1s 33792K ........ ........ ........ ........ ........ ........ 16% 164M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 217M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 228M 1s 43008K ........ ........ ........ ........ ........ ........ 20% 283M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 317M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 325M 1s 52224K ........ ........ ........ ........ ........ ........ 24% 321M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 318M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 330M 1s 61440K ........ ........ ........ ........ ........ ........ 28% 316M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 329M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 326M 1s 70656K ........ ........ ........ ........ ........ ........ 32% 318M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 319M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 337M 1s 79872K ........ ........ ........ ........ ........ ........ 36% 321M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 321M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 326M 1s 89088K ........ ........ ........ ........ ........ ........ 40% 384M 1s 92160K ........ ........ ........ ........ ........ ........ 41% 397M 1s 95232K ........ ........ ........ ........ ........ ........ 42% 366M 1s 98304K ........ ........ ........ ........ ........ ........ 44% 382M 1s 101376K ........ ........ ........ ........ ........ ........ 45% 385M 1s 104448K ........ ........ ........ ........ ........ ........ 47% 390M 0s 107520K ........ ........ ........ ........ ........ ........ 48% 389M 0s 110592K ........ ........ ........ ........ ........ ........ 49% 384M 0s 113664K ........ ........ ........ ........ ........ ........ 51% 373M 0s 116736K ........ ........ ........ ........ ........ ........ 52% 380M 0s 119808K ........ ........ ........ ........ ........ ........ 53% 379M 0s 122880K ........ ........ ........ ........ ........ ........ 55% 377M 0s 125952K ........ ........ ........ ........ ........ ........ 56% 370M 0s 129024K ........ ........ ........ ........ ........ ........ 57% 364M 0s 132096K ........ ........ ........ ........ ........ ........ 59% 378M 0s 135168K ........ ........ ........ ........ ........ ........ 60% 352M 0s 138240K ........ ........ ........ ........ ........ ........ 61% 377M 0s 141312K ........ ........ ........ ........ ........ ........ 63% 398M 0s 144384K ........ ........ ........ ........ ........ ........ 64% 387M 0s 147456K ........ ........ ........ ........ ........ ........ 65% 386M 0s 150528K ........ ........ ........ ........ ........ ........ 67% 373M 0s 153600K ........ ........ ........ ........ ........ ........ 68% 400M 0s 156672K ........ ........ ........ ........ ........ ........ 69% 382M 0s 159744K ........ ........ ........ ........ ........ ........ 71% 381M 0s 162816K ........ ........ ........ ........ ........ ........ 72% 384M 0s 165888K ........ ........ ........ ........ ........ ........ 73% 388M 0s 168960K ........ ........ ........ ........ ........ ........ 75% 377M 0s 172032K ........ ........ ........ ........ ........ ........ 76% 317M 0s 175104K ........ ........ ........ ........ ........ ........ 77% 136M 0s 178176K ........ ........ ........ ........ ........ ........ 79% 316M 0s 181248K ........ ........ ........ ........ ........ ........ 80% 370M 0s 184320K ........ ........ ........ ........ ........ ........ 81% 397M 0s 187392K ........ ........ ........ ........ ........ ........ 83% 393M 0s 190464K ........ ........ ........ ........ ........ ........ 84% 404M 0s 193536K ........ ........ ........ ........ ........ ........ 85% 398M 0s 196608K ........ ........ ........ ........ ........ ........ 87% 393M 0s 199680K ........ ........ ........ ........ ........ ........ 88% 147M 0s 202752K ........ ........ ........ ........ ........ ........ 90% 352M 0s 205824K ........ ........ ........ ........ ........ ........ 91% 271M 0s 208896K ........ ........ ........ ........ ........ ........ 92% 265M 0s 211968K ........ ........ ........ ........ ........ ........ 94% 260M 0s 215040K ........ ........ ........ ........ ........ ........ 95% 307M 0s 218112K ........ ........ ........ ........ ........ ........ 96% 304M 0s 221184K ........ ........ ........ ........ ........ ........ 98% 328M 0s 224256K ........ ........ ........ ........ ........ ........ 99% 313M 0s 227328K ........ ........ .... 100% 336M=0.8s 2024-04-14 12:13:42 (283 MB/s) - ‘karaf-0.19.3-20240414.094318-133.zip’ saved [234135179/234135179] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.19.3-20240414.094318-133.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.19.3-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/081deb70-d058-48a5-85a0-90674092d147.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, bf4dcf4a-f372-4b81-98e1-c62bf69e2662 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv Configure + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 164 10.30.170.28:22 10.30.171.237:50004 ESTABLISHED - tcp 0 0 10.30.170.28:44348 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.170.28:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - Custom shard config exists!!! + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' Copying the shard config... + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.19.3-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.19.3-SNAPSHOT/bin/configure_cluster.sh 1 10.30.170.28 10.30.171.37 10.30.171.13 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.19.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/8.0.5 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.28" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.28:2550", "akka://opendaylight-cluster-data@10.30.171.37:2550", "akka://opendaylight-cluster-data@10.30.171.13:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.171.37 Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. common-functions.sh is being sourced + source /tmp/common-functions.sh karaf-0.19.3-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.19.3-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip --2024-04-14 12:13:46-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 234135179 (223M) [application/zip] Saving to: ‘karaf-0.19.3-20240414.094318-133.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 60.3M 4s 3072K ........ ........ ........ ........ ........ ........ 2% 147M 3s 6144K ........ ........ ........ ........ ........ ........ 4% 139M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 126M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 183M 2s 15360K ........ ........ ........ ........ ........ ........ 8% 163M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 171M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 207M 2s 24576K ........ ........ ........ ........ ........ ........ 12% 226M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 240M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 237M 1s 33792K ........ ........ ........ ........ ........ ........ 16% 237M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 247M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 229M 1s 43008K ........ ........ ........ ........ ........ ........ 20% 241M 1s 46080K ........ ........ ........ ........ ........ ........ 21% 247M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 238M 1s 52224K ........ ........ ........ ........ ........ ........ 24% 244M 1s 55296K ........ ........ ........ ........ ........ ........ 25% 241M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 233M 1s 61440K ........ ........ ........ ........ ........ ........ 28% 294M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 292M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 288M 1s 70656K ........ ........ ........ ........ ........ ........ 32% 309M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 311M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 216M 1s 79872K ........ ........ ........ ........ ........ ........ 36% 283M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 333M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 270M 1s 89088K ........ ........ ........ ........ ........ ........ 40% 233M 1s 92160K ........ ........ ........ ........ ........ ........ 41% 169M 1s 95232K ........ ........ ........ ........ ........ ........ 42% 395M 1s 98304K ........ ........ ........ ........ ........ ........ 44% 402M 1s 101376K ........ ........ ........ ........ ........ ........ 45% 344M 1s 104448K ........ ........ ........ ........ ........ ........ 47% 306M 1s 107520K ........ ........ ........ ........ ........ ........ 48% 304M 1s 110592K ........ ........ ........ ........ ........ ........ 49% 308M 1s 113664K ........ ........ ........ ........ ........ ........ 51% 298M 1s 116736K ........ ........ ........ ........ ........ ........ 52% 296M 0s 119808K ........ ........ ........ ........ ........ ........ 53% 298M 0s 122880K ........ ........ ........ ........ ........ ........ 55% 304M 0s 125952K ........ ........ ........ ........ ........ ........ 56% 308M 0s 129024K ........ ........ ........ ........ ........ ........ 57% 299M 0s 132096K ........ ........ ........ ........ ........ ........ 59% 314M 0s 135168K ........ ........ ........ ........ ........ ........ 60% 317M 0s 138240K ........ ........ ........ ........ ........ ........ 61% 221M 0s 141312K ........ ........ ........ ........ ........ ........ 63% 322M 0s 144384K ........ ........ ........ ........ ........ ........ 64% 300M 0s 147456K ........ ........ ........ ........ ........ ........ 65% 395M 0s 150528K ........ ........ ........ ........ ........ ........ 67% 341M 0s 153600K ........ ........ ........ ........ ........ ........ 68% 317M 0s 156672K ........ ........ ........ ........ ........ ........ 69% 300M 0s 159744K ........ ........ ........ ........ ........ ........ 71% 317M 0s 162816K ........ ........ ........ ........ ........ ........ 72% 297M 0s 165888K ........ ........ ........ ........ ........ ........ 73% 301M 0s 168960K ........ ........ ........ ........ ........ ........ 75% 319M 0s 172032K ........ ........ ........ ........ ........ ........ 76% 309M 0s 175104K ........ ........ ........ ........ ........ ........ 77% 295M 0s 178176K ........ ........ ........ ........ ........ ........ 79% 300M 0s 181248K ........ ........ ........ ........ ........ ........ 80% 291M 0s 184320K ........ ........ ........ ........ ........ ........ 81% 288M 0s 187392K ........ ........ ........ ........ ........ ........ 83% 318M 0s 190464K ........ ........ ........ ........ ........ ........ 84% 295M 0s 193536K ........ ........ ........ ........ ........ ........ 85% 295M 0s 196608K ........ ........ ........ ........ ........ ........ 87% 292M 0s 199680K ........ ........ ........ ........ ........ ........ 88% 283M 0s 202752K ........ ........ ........ ........ ........ ........ 90% 243M 0s 205824K ........ ........ ........ ........ ........ ........ 91% 262M 0s 208896K ........ ........ ........ ........ ........ ........ 92% 294M 0s 211968K ........ ........ ........ ........ ........ ........ 94% 175M 0s 215040K ........ ........ ........ ........ ........ ........ 95% 287M 0s 218112K ........ ........ ........ ........ ........ ........ 96% 283M 0s 221184K ........ ........ ........ ........ ........ ........ 98% 279M 0s 224256K ........ ........ ........ ........ ........ ........ 99% 286M 0s 227328K ........ ........ .... 100% 312M=0.9s 2024-04-14 12:13:47 (249 MB/s) - ‘karaf-0.19.3-20240414.094318-133.zip’ saved [234135179/234135179] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.19.3-20240414.094318-133.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.19.3-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/081deb70-d058-48a5-85a0-90674092d147.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, bf4dcf4a-f372-4b81-98e1-c62bf69e2662 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS controllerdebugmap: cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv Configure java home: /usr/lib/jvm/java-17-openjdk + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' max memory: 3072m memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + echo ' memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.37:33632 199.204.45.87:443 TIME_WAIT - tcp 0 164 10.30.171.37:22 10.30.171.237:59870 ESTABLISHED - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.171.37:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.19.3-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.19.3-SNAPSHOT/bin/configure_cluster.sh 2 10.30.170.28 10.30.171.37 10.30.171.13 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.19.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/8.0.5 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.37" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.28:2550", "akka://opendaylight-cluster-data@10.30.171.37:2550", "akka://opendaylight-cluster-data@10.30.171.13:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.171.13 Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.19.3-SNAPSHOT ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.19.3-SNAPSHOT ++ export MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ export AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip --2024-04-14 12:13:50-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 234135179 (223M) [application/zip] Saving to: ‘karaf-0.19.3-20240414.094318-133.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 25.9M 8s 3072K ........ ........ ........ ........ ........ ........ 2% 67.7M 6s 6144K ........ ........ ........ ........ ........ ........ 4% 137M 4s 9216K ........ ........ ........ ........ ........ ........ 5% 162M 4s 12288K ........ ........ ........ ........ ........ ........ 6% 197M 3s 15360K ........ ........ ........ ........ ........ ........ 8% 161M 3s 18432K ........ ........ ........ ........ ........ ........ 9% 167M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 191M 2s 24576K ........ ........ ........ ........ ........ ........ 12% 196M 2s 27648K ........ ........ ........ ........ ........ ........ 13% 211M 2s 30720K ........ ........ ........ ........ ........ ........ 14% 206M 2s 33792K ........ ........ ........ ........ ........ ........ 16% 211M 2s 36864K ........ ........ ........ ........ ........ ........ 17% 81.6M 2s 39936K ........ ........ ........ ........ ........ ........ 18% 39.9M 2s 43008K ........ ........ ........ ........ ........ ........ 20% 177M 2s 46080K ........ ........ ........ ........ ........ ........ 21% 248M 2s 49152K ........ ........ ........ ........ ........ ........ 22% 274M 2s 52224K ........ ........ ........ ........ ........ ........ 24% 251M 2s 55296K ........ ........ ........ ........ ........ ........ 25% 222M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 256M 1s 61440K ........ ........ ........ ........ ........ ........ 28% 249M 1s 64512K ........ ........ ........ ........ ........ ........ 29% 262M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 268M 1s 70656K ........ ........ ........ ........ ........ ........ 32% 324M 1s 73728K ........ ........ ........ ........ ........ ........ 33% 322M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 320M 1s 79872K ........ ........ ........ ........ ........ ........ 36% 309M 1s 82944K ........ ........ ........ ........ ........ ........ 37% 309M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 296M 1s 89088K ........ ........ ........ ........ ........ ........ 40% 318M 1s 92160K ........ ........ ........ ........ ........ ........ 41% 326M 1s 95232K ........ ........ ........ ........ ........ ........ 42% 327M 1s 98304K ........ ........ ........ ........ ........ ........ 44% 34.1M 1s 101376K ........ ........ ........ ........ ........ ........ 45% 290M 1s 104448K ........ ........ ........ ........ ........ ........ 47% 312M 1s 107520K ........ ........ ........ ........ ........ ........ 48% 301M 1s 110592K ........ ........ ........ ........ ........ ........ 49% 301M 1s 113664K ........ ........ ........ ........ ........ ........ 51% 300M 1s 116736K ........ ........ ........ ........ ........ ........ 52% 292M 1s 119808K ........ ........ ........ ........ ........ ........ 53% 252M 1s 122880K ........ ........ ........ ........ ........ ........ 55% 370M 1s 125952K ........ ........ ........ ........ ........ ........ 56% 329M 1s 129024K ........ ........ ........ ........ ........ ........ 57% 313M 1s 132096K ........ ........ ........ ........ ........ ........ 59% 318M 1s 135168K ........ ........ ........ ........ ........ ........ 60% 316M 1s 138240K ........ ........ ........ ........ ........ ........ 61% 304M 1s 141312K ........ ........ ........ ........ ........ ........ 63% 136M 1s 144384K ........ ........ ........ ........ ........ ........ 64% 362M 0s 147456K ........ ........ ........ ........ ........ ........ 65% 230M 0s 150528K ........ ........ ........ ........ ........ ........ 67% 207M 0s 153600K ........ ........ ........ ........ ........ ........ 68% 123M 0s 156672K ........ ........ ........ ........ ........ ........ 69% 302M 0s 159744K ........ ........ ........ ........ ........ ........ 71% 216M 0s 162816K ........ ........ ........ ........ ........ ........ 72% 167M 0s 165888K ........ ........ ........ ........ ........ ........ 73% 181M 0s 168960K ........ ........ ........ ........ ........ ........ 75% 205M 0s 172032K ........ ........ ........ ........ ........ ........ 76% 240M 0s 175104K ........ ........ ........ ........ ........ ........ 77% 125M 0s 178176K ........ ........ ........ ........ ........ ........ 79% 275M 0s 181248K ........ ........ ........ ........ ........ ........ 80% 261M 0s 184320K ........ ........ ........ ........ ........ ........ 81% 305M 0s 187392K ........ ........ ........ ........ ........ ........ 83% 299M 0s 190464K ........ ........ ........ ........ ........ ........ 84% 309M 0s 193536K ........ ........ ........ ........ ........ ........ 85% 308M 0s 196608K ........ ........ ........ ........ ........ ........ 87% 303M 0s 199680K ........ ........ ........ ........ ........ ........ 88% 289M 0s 202752K ........ ........ ........ ........ ........ ........ 90% 205M 0s 205824K ........ ........ ........ ........ ........ ........ 91% 379M 0s 208896K ........ ........ ........ ........ ........ ........ 92% 374M 0s 211968K ........ ........ ........ ........ ........ ........ 94% 353M 0s 215040K ........ ........ ........ ........ ........ ........ 95% 309M 0s 218112K ........ ........ ........ ........ ........ ........ 96% 283M 0s 221184K ........ ........ ........ ........ ........ ........ 98% 289M 0s 224256K ........ ........ ........ ........ ........ ........ 99% 324M 0s 227328K ........ ........ .... 100% 317M=1.2s 2024-04-14 12:13:51 (185 MB/s) - ‘karaf-0.19.3-20240414.094318-133.zip’ saved [234135179/234135179] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.19.3-20240414.094318-133.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.19.3-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.19.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/081deb70-d058-48a5-85a0-90674092d147.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, bf4dcf4a-f372-4b81-98e1-c62bf69e2662 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' controllerdebugmap: + '[' -n '' ']' cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-17-openjdk 3072m /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-17-openjdk + local -r controllermem=3072m Configure java home: /usr/lib/jvm/java-17-openjdk max memory: 3072m memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + local -r memconf=/tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-17-openjdk' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk}%g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-17-openjdk} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true + echo 'Set Java version' Set Java version + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-17-openjdk/bin/java 1 + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-17-openjdk/bin/java JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "17.0.6-ea" 2023-01-17 LTS OpenJDK Runtime Environment (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.6.0.9-0.3.ea.el8) (build 17.0.6-ea+9-LTS, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-17-openjdk + JAVA_HOME=/usr/lib/jvm/java-17-openjdk ++ readlink -e /usr/lib/jvm/java-17-openjdk/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java Listing all open ports on controller system... + JAVA_RESOLVED=/usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-17-openjdk-17.0.6.0.9-0.3.ea.el8.x86_64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.13:22 10.30.171.237:54534 ESTABLISHED - tcp 0 0 10.30.171.13:42558 199.204.45.87:443 TIME_WAIT - tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::22 :::* LISTEN - udp 0 0 10.30.171.13:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.19.3-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.19.3-SNAPSHOT/bin/configure_cluster.sh 3 10.30.170.28 10.30.171.37 10.30.171.13 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.19.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/8.0.5 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.13" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.170.28:2550", "akka://opendaylight-cluster-data@10.30.171.37:2550", "akka://opendaylight-cluster-data@10.30.171.13:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.170.28 Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.171.37 Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.171.13 Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins13125785121506048969.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.19.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.19.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.19.3-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.19.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.170.28' Execute the post startup script on controller 10.30.170.28 + scp /w/workspace/controller-csit-3node-clustering-ask-all-potassium/post-startup-script.sh 10.30.170.28:/tmp/ Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + ssh 10.30.170.28 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-14T12:14:39,310 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-14T12:14:39,310 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.170.28:44348 199.204.45.87:443 TIME_WAIT - tcp 0 164 10.30.170.28:22 10.30.171.237:39640 ESTABLISHED - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5730/java tcp6 0 0 :::6653 :::* LISTEN 5730/java tcp6 0 0 :::4189 :::* LISTEN 5730/java tcp6 0 0 :::1790 :::* LISTEN 5730/java tcp6 0 0 :::8101 :::* LISTEN 5730/java tcp6 0 0 127.0.0.1:39365 :::* LISTEN 5730/java tcp6 0 0 :::6633 :::* LISTEN 5730/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5730/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5730/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5730/java tcp6 0 0 10.30.170.28:2550 :::* LISTEN 5730/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 10.30.170.28:45864 10.30.171.37:2550 ESTABLISHED 5730/java tcp6 0 0 10.30.170.28:35166 10.30.171.13:2550 ESTABLISHED 5730/java tcp6 32 0 10.30.170.28:44578 199.204.45.87:443 CLOSE_WAIT 5730/java tcp6 0 0 10.30.170.28:2550 10.30.171.13:48178 ESTABLISHED 5730/java tcp6 0 0 10.30.170.28:35178 10.30.171.13:2550 ESTABLISHED 5730/java tcp6 0 0 10.30.170.28:2550 10.30.171.37:45730 ESTABLISHED 5730/java tcp6 0 0 127.0.0.1:48936 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 127.0.0.1:59478 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 127.0.0.1:59474 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.170.28:2550 10.30.171.13:48186 ESTABLISHED 5730/java tcp6 0 0 10.30.170.28:2550 10.30.171.37:45740 ESTABLISHED 5730/java tcp6 0 0 10.30.170.28:45872 10.30.171.37:2550 ESTABLISHED 5730/java udp 0 0 10.30.170.28:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5730/java looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.171.37' Execute the post startup script on controller 10.30.171.37 + scp /w/workspace/controller-csit-3node-clustering-ask-all-potassium/post-startup-script.sh 10.30.171.37:/tmp/ Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + ssh 10.30.171.37 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-14T12:14:39,987 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-14T12:14:39,987 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.37:33632 199.204.45.87:443 TIME_WAIT - tcp 0 164 10.30.171.37:22 10.30.171.237:54230 ESTABLISHED - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5751/java tcp6 0 0 :::6653 :::* LISTEN 5751/java tcp6 0 0 :::1790 :::* LISTEN 5751/java tcp6 0 0 :::8101 :::* LISTEN 5751/java tcp6 0 0 :::6633 :::* LISTEN 5751/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5751/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5751/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5751/java tcp6 0 0 127.0.0.1:44661 :::* LISTEN 5751/java tcp6 0 0 10.30.171.37:2550 :::* LISTEN 5751/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 :::12345 :::* LISTEN 5751/java tcp6 0 0 127.0.0.1:58344 127.0.0.1:44444 TIME_WAIT - tcp6 32 0 10.30.171.37:40450 199.204.45.87:443 CLOSE_WAIT 5751/java tcp6 0 0 10.30.171.37:2550 10.30.171.13:40092 ESTABLISHED 5751/java tcp6 0 0 127.0.0.1:36218 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 10.30.171.37:2550 10.30.170.28:45872 ESTABLISHED 5751/java tcp6 0 0 10.30.171.37:33106 10.30.171.13:2550 ESTABLISHED 5751/java tcp6 0 0 10.30.171.37:2550 10.30.170.28:45864 ESTABLISHED 5751/java tcp6 0 0 10.30.171.37:45730 10.30.170.28:2550 ESTABLISHED 5751/java tcp6 0 0 10.30.171.37:2550 10.30.171.13:40082 ESTABLISHED 5751/java tcp6 0 0 127.0.0.1:46234 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.37:33094 10.30.171.13:2550 ESTABLISHED 5751/java tcp6 0 0 10.30.171.37:45740 10.30.170.28:2550 ESTABLISHED 5751/java udp 0 0 10.30.171.37:68 10.30.170.2:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5751/java looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.171.13' Execute the post startup script on controller 10.30.171.13 + scp /w/workspace/controller-csit-3node-clustering-ask-all-potassium/post-startup-script.sh 10.30.171.13:/tmp/ Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + ssh 10.30.171.13 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. tcp6 0 0 :::8101 :::* LISTEN Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2024-04-14T12:14:40,441 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2024-04-14T12:14:40,441 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 292 - org.opendaylight.infrautils.ready-api - 6.0.6 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - tcp 0 0 10.30.171.13:42558 199.204.45.87:443 TIME_WAIT - tcp 0 0 10.30.171.13:22 10.30.171.237:57920 ESTABLISHED - tcp6 0 0 :::6633 :::* LISTEN 5744/java tcp6 0 0 127.0.0.1:1099 :::* LISTEN 5744/java tcp6 0 0 :::111 :::* LISTEN - tcp6 0 0 :::6640 :::* LISTEN 5744/java tcp6 0 0 127.0.0.1:43891 :::* LISTEN 5744/java tcp6 0 0 :::5555 :::* LISTEN - tcp6 0 0 :::8181 :::* LISTEN 5744/java tcp6 0 0 10.30.171.13:2550 :::* LISTEN 5744/java tcp6 0 0 :::22 :::* LISTEN - tcp6 0 0 127.0.0.1:44444 :::* LISTEN 5744/java tcp6 0 0 :::6653 :::* LISTEN 5744/java tcp6 0 0 :::1790 :::* LISTEN 5744/java tcp6 0 0 :::8101 :::* LISTEN 5744/java tcp6 0 0 127.0.0.1:34674 127.0.0.1:1099 TIME_WAIT - tcp6 0 0 127.0.0.1:39886 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.13:2550 10.30.170.28:35178 ESTABLISHED 5744/java tcp6 0 0 10.30.171.13:2550 10.30.171.37:33094 ESTABLISHED 5744/java tcp6 0 0 10.30.171.13:40092 10.30.171.37:2550 ESTABLISHED 5744/java tcp6 0 0 10.30.171.13:48178 10.30.170.28:2550 ESTABLISHED 5744/java tcp6 0 0 10.30.171.13:40082 10.30.171.37:2550 ESTABLISHED 5744/java tcp6 32 0 10.30.171.13:51400 199.204.45.87:443 CLOSE_WAIT 5744/java tcp6 0 0 10.30.171.13:48186 10.30.170.28:2550 ESTABLISHED 5744/java tcp6 0 0 127.0.0.1:39898 127.0.0.1:44444 TIME_WAIT - tcp6 0 0 10.30.171.13:2550 10.30.171.37:33106 ESTABLISHED 5744/java tcp6 0 0 10.30.171.13:2550 10.30.170.28:35166 ESTABLISHED 5744/java udp 0 0 10.30.171.13:68 10.30.170.3:67 ESTABLISHED - udp 0 0 0.0.0.0:111 0.0.0.0:* - udp 0 0 127.0.0.1:323 0.0.0.0:* - udp6 0 0 :::111 :::* - udp6 0 0 ::1:323 :::* - udp6 0 0 :::4342 :::* 5744/java looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.28 'sudo ps aux' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=5730 + echo 'karaf main: org.apache.karaf.main.Main, pid:5730' karaf main: org.apache.karaf.main.Main, pid:5730 + ssh 10.30.170.28 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5730' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.37 'sudo ps aux' Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5751 + echo 'karaf main: org.apache.karaf.main.Main, pid:5751' karaf main: org.apache.karaf.main.Main, pid:5751 + ssh 10.30.171.37 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5751' Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.13 'sudo ps aux' Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_before.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=5744 + echo 'karaf main: org.apache.karaf.main.Main, pid:5744' karaf main: org.apache.karaf.main.Main, pid:5744 + ssh 10.30.171.13 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5744' Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.28' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.28 -v ODL_SYSTEM_2_IP:10.30.171.37' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.170.28 -v ODL_SYSTEM_2_IP:10.30.171.37 -v ODL_SYSTEM_3_IP:10.30.171.13' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/testplans/controller-clustering-ask-potassium.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/testplans/controller-clustering-ask-potassium.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/testplans/controller-clustering-ask.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-ask-all-potassium: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/testplans/controller-clustering-ask.txt + cat testplan.txt # Place the suites in run order: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-ask.txt --removekeywords wuks -e exclude -e skip_if_potassium -v BUNDLEFOLDER:karaf-0.19.3-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.19.3-SNAPSHOT/karaf-0.19.3-20240414.094318-133.zip -v CONTROLLER:10.30.170.28 -v CONTROLLER1:10.30.171.37 -v CONTROLLER2:10.30.171.13 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-17-openjdk -v JDKVERSION:openjdk17 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-ask-all-potassium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:potassium -v ODL_SYSTEM_IP:10.30.170.28 -v ODL_SYSTEM_1_IP:10.30.170.28 -v ODL_SYSTEM_2_IP:10.30.171.37 -v ODL_SYSTEM_3_IP:10.30.171.13 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-ask-all-potassium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-ask.txt ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBroker testi... ============================================================================== Register_Rpc_On_Each_Node :: Register global rpc on each node of t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_register_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | ------------------------------------------------------------------------------ Reregister_Rpc_On_Node :: Reregister the rpc. | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_precedence_unregister_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Rpc Provider Precedence :: DOMRpcBro... | FAIL | 8 tests, 4 passed, 4 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Rpc Provider Partition And Heal :: DOMRpcBrok... ============================================================================== Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Invoke get-constant rpc on every node o... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Isolate_One_Node :: Isolate one node with registered rpc. From the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_isolate_one_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Nonisolated_Nodes :: Invoke rpc on non-islolated nodes. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_nonisolated_nodes&order=bug_status" Keyword 'DrbCommons.Verify_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" Variable '${isolated_idx}' not found. ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-constant on every ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_rpc_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" Keyword 'Verify_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | PASS | ------------------------------------------------------------------------------ controller-clustering-ask.txt.Rpc Provider Partition And Heal :: D... | FAIL | 7 tests, 2 passed, 5 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Action Provider Precedence :: DOMRpcBroker te... ============================================================================== Register_Rpc_On_Each_Node :: Register routed rpc on each node of t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_register_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Verify that the rpc response comes from... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Node :: Unregister the rpc on one of the cluster... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Node_With_Unregistered_Rpc :: Invoke rcp on the node... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Verify that the rpc response come... | PASS | ------------------------------------------------------------------------------ Reregister_Rpc_On_Node :: Reregister the rpc. | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Verify that the rpc response come... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_invoke_rpc_on_each_node_again&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Unregister rpc on every node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_precedence_unregister_rpc_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Action Provider Precedence :: DOMRpc... | FAIL | 8 tests, 4 passed, 4 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Action Provider Partition And Heal :: DOMRpcB... ============================================================================== Register_Rpc_On_Two_Nodes :: Register rpc on two nodes of the odl ... | PASS | ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node :: Invoke get-contexted-constant rpc on ev... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node&order=bug_status" Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Isolate_One_Node :: Isolate one node with registered rpc. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_isolate_one_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Invoke_Rpc_On_Remaining_Nodes :: Invoke rpc on non-islolated nodes... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_remaining_nodes&order=bug_status" Keyword 'DrbCommons.Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 1 minute. The last error was: Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_rejoin_isolated_member&order=bug_status" Variable '${isolated_idx}' not found. ------------------------------------------------------------------------------ Invoke_Rpc_On_Each_Node_Again :: Invoke rpc get-contexted-constant... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_action_provider_partition_and_heal_invoke_rpc_on_each_node_again&order=bug_status" Keyword 'Verify_Contexted_Constant_On_Active_Nodes' failed after retrying for 10 seconds. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Rpc_On_Each_Node :: Inregister rpc on both nodes. | PASS | ------------------------------------------------------------------------------ controller-clustering-ask.txt.Action Provider Partition And Heal :... | FAIL | 7 tests, 2 passed, 5 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Master Stability :: Cluster Singleton testing... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Master Stability :: Cluster Singleto... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Partition And Heal :: Cluster Singleton testi... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Partition And Heal :: Cluster Single... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Chasing The Leader :: Cluster Singleton testi... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_register_candidates&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_ask_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Chasing The Leader :: Cluster Single... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Kill :: Controller functional HA t... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Stopping_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Stop_On_Successors :: Run rpc on non owher cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Stop_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Restart_Stopped_Member :: Restart stopped node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Owner_Remained_After_Rejoin :: Verify no owner change h... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Kill :: Controller functi... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 11 tests, 0 passed, 11 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Freeze :: Controller functional HA... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Freezing_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Freeze_On_Successors :: Run rpc on non owher cluster no... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Freeze_Current_Owner_Member :: Stop cluster node which is the owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Remained_Cluster_Nodes :: Run rpc on remained cluster nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Unfreeze_Frozen_Member :: Restart frozen node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Freeze :: Controller func... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Global Rpc Isolate :: Controller functional H... ============================================================================== Get_Basic_Rpc_Test_Owner :: Find a service owner and successors. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Isolation_On_Owner :: Run rpc on the service owner. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_Before_Isolation_On_Successors :: Run rpc on non owher cluster... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Isolate_Current_Owner_Member :: Isolating cluster node which is th... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Verify_New_Basic_Rpc_Test_Owner_Elected :: Verify new owner of the... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Isolated_Node :: Run rpc on isolated cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_On_Non_Isolated_Cluster_Nodes :: Run rpc on remained cluster n... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rejoin_Isolated_Member :: Rejoin isolated node | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_New_Owner :: Run rpc on the new service owner ... | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_Old_Owner :: Run rpc on rejoined cluster node. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ Rpc_After_Rejoin_On_All :: Run rpc again on all nodes. | FAIL | Parent suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . ------------------------------------------------------------------------------ controller-clustering-ask.txt.Global Rpc Isolate :: Controller fun... | FAIL | Suite setup failed: No match found for 'opendaylight-user' in 10 seconds Output: . 11 tests, 0 passed, 11 failed ============================================================================== controller-clustering-ask.txt.Restart Odl With Tell Based False :: Unset te... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Unset_Tell_Based_Protocol_Usage :: Comment out the flag usage in c... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Restart Odl With Tell Based False ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-ask.txt.Carpeople Crud :: Suite for performing basic ... ============================================================================== Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Carpeople Crud :: Suite for performi... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-ask.txt.Car Failover Crud :: Suite mixing basic opera... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Failover Crud :: Suite mixing ba... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-ask.txt.Car Persistence Recovery :: This test restart... ============================================================================== Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Persistence Recovery :: This tes... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-ask.txt.Buycar Failover :: This test focuses on testi... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Buycar Failover :: This test focuses... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Entity Isolate :: Suite for performing member... ============================================================================== Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Entity Isolate :: Suite for performi... | FAIL | Suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1358)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...clipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:833)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-ask.txt.Buycar Failover Isolation :: This test focuse... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Buycar Failover Isolation :: This te... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite mixing b... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Failover Crud Isolation :: Suite... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-ask.txt.Car Outage Corners :: Cluster suite for testi... ============================================================================== Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) ------------------------------------------------------------------------------ controller-clustering-ask.txt.Car Outage Corners :: Cluster suite ... | FAIL | Suite setup failed: ReadTimeout: HTTPConnectionPool(host='10.30.171.13', port=8181): Read timed out. (read timeout=5.0) 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-ask.txt | FAIL | 195 tests, 24 passed, 171 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/output.xml Log: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/log.html Report: /w/workspace/controller-csit-3node-clustering-ask-all-potassium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.170.28 'ls -altr /tmp/karaf-0.19.3-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. total 22596 drwxrwxr-x. 2 jenkins jenkins 48 Apr 14 12:13 . -rw-rw-r--. 1 jenkins jenkins 1720 Apr 14 12:13 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Apr 14 16:13 .. -rw-rw-r--. 1 jenkins jenkins 14809344 Apr 14 16:27 karaf.log + ssh 10.30.170.28 'du -hs /tmp/karaf-0.19.3-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 23M /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log + ssh 10.30.171.37 'ls -altr /tmp/karaf-0.19.3-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. total 22596 drwxrwxr-x. 2 jenkins jenkins 48 Apr 14 12:13 . -rw-rw-r--. 1 jenkins jenkins 1720 Apr 14 12:13 karaf_console.log drwxrwxr-x. 9 jenkins jenkins 149 Apr 14 16:13 .. -rw-rw-r--. 1 jenkins jenkins 14803032 Apr 14 16:27 karaf.log + ssh 10.30.171.37 'du -hs /tmp/karaf-0.19.3-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. 4.0K /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 23M /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log + ssh 10.30.171.13 'ls -altr /tmp/karaf-0.19.3-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. total 11356 drwxrwxr-x. 2 jenkins jenkins 48 Apr 14 12:13 . -rw-rw-r--. 1 jenkins jenkins 159688 Apr 14 12:50 karaf_console.log drwxrwxr-x. 4 jenkins jenkins 28 Apr 14 16:12 .. -rw-rw-r--. 1 jenkins jenkins 7327042 Apr 14 16:27 karaf.log + ssh 10.30.171.13 'du -hs /tmp/karaf-0.19.3-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. 156K /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log 11M /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.28 'sudo ps aux' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_after.log ++ cut -f2 '-d ' ++ grep -v grep + pid=29385 + echo 'karaf main: org.apache.karaf.main.Main, pid:29385' karaf main: org.apache.karaf.main.Main, pid:29385 + ssh 10.30.170.28 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 29385' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.28 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.37 'sudo ps aux' Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_after.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=28589 + echo 'karaf main: org.apache.karaf.main.Main, pid:28589' karaf main: org.apache.karaf.main.Main, pid:28589 + ssh 10.30.171.37 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 28589' Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.37 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.13 'sudo ps aux' Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-ask-all-potassium/ps_after.log ++ cut -f2 '-d ' ++ grep -v grep + pid=5744 + echo 'karaf main: org.apache.karaf.main.Main, pid:5744' karaf main: org.apache.karaf.main.Main, pid:5744 + ssh 10.30.171.13 '/usr/lib/jvm/java-17-openjdk/bin/jstack -l 5744' Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.13 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.170.28 gzip --best /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.170.28:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + ssh 10.30.170.28 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + scp 10.30.170.28:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + ssh 10.30.170.28 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.170.28:/tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.171.37 gzip --best /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.171.37:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + ssh 10.30.171.37 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + scp 10.30.171.37:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + ssh 10.30.171.37 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.171.37:/tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.171.37' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.171.13 gzip --best /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.171.13:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + ssh 10.30.171.13 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + scp 10.30.171.13:/tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + ssh 10.30.171.13 rm -f /tmp/karaf-0.19.3-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.171.13:/tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.171.13' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.19.3-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 52024 drwxrwxr-x. 2 jenkins jenkins 6 Apr 14 16:28 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 159688 Apr 14 16:28 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 304709 Apr 14 16:28 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Apr 14 16:28 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 14 16:28 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 968979 Apr 14 16:28 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Apr 14 16:28 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Apr 14 16:28 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 977463 Apr 14 16:28 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 133779 Apr 14 16:28 karaf_3_5744_threads_after.log -rw-rw-r--. 1 jenkins jenkins 15704 Apr 14 16:28 ps_after.log -rw-rw-r--. 1 jenkins jenkins 126780 Apr 14 16:28 karaf_2_28589_threads_after.log -rw-rw-r--. 1 jenkins jenkins 118489 Apr 14 16:28 karaf_1_29385_threads_after.log -rw-rw-r--. 1 jenkins jenkins 300997 Apr 14 16:28 report.html -rw-rw-r--. 1 jenkins jenkins 3408879 Apr 14 16:28 log.html -rw-rw-r--. 1 jenkins jenkins 46215448 Apr 14 16:27 output.xml -rw-rw-r--. 1 jenkins jenkins 4149 Apr 14 12:14 testplan.txt -rw-rw-r--. 1 jenkins jenkins 136985 Apr 14 12:14 karaf_3_5744_threads_before.log -rw-rw-r--. 1 jenkins jenkins 17016 Apr 14 12:14 ps_before.log -rw-rw-r--. 1 jenkins jenkins 140635 Apr 14 12:14 karaf_2_5751_threads_before.log -rw-rw-r--. 1 jenkins jenkins 144252 Apr 14 12:14 karaf_1_5730_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Apr 14 12:13 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Apr 14 12:13 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3452 Apr 14 12:13 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Apr 14 12:13 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 136 Apr 14 12:13 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 337 Apr 14 12:13 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2620 Apr 14 12:13 pom.xml -rw-rw-r--. 1 jenkins jenkins 86 Apr 14 12:13 set_variables.env -rw-rw-r--. 1 jenkins jenkins 310 Apr 14 12:13 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Apr 14 12:13 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Apr 14 12:13 env.properties -rw-rw-r--. 1 jenkins jenkins 335 Apr 14 12:11 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Apr 14 12:09 test drwxrwxr-x. 2 jenkins jenkins 6 Apr 14 12:09 test@tmp -rw-rw-r--. 1 jenkins jenkins 1410 Apr 14 09:43 maven-metadata.xml + true [controller-csit-3node-clustering-ask-all-potassium] $ /bin/sh /tmp/jenkins6773392855313297513.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5286 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins14536560944460958904.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 4222k 0 4222k 0 0 4996k 0 --:--:-- --:--:-- --:--:-- 4996k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins201556362482792550.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-ask-all-potassium-39 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins9137870913615904799.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes python-heatclient python-openstackclient lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH INFO: Retrieving stack cost for: releng-controller-csit-3node-clustering-ask-all-potassium-39 DEBUG: Successfully retrieved stack cost: total: 1.6500000000000001 INFO: Deleting stack releng-controller-csit-3node-clustering-ask-all-potassium-39 Successfully deleted stack releng-controller-csit-3node-clustering-ask-all-potassium-39 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins18195414288183573069.sh ---> sysstat.sh [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins14662323874274430895.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-ask-all-potassium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-ask-all-potassium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-ask-all-potassium ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-ask-all-potassium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-ask-all-potassium/archives/ [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins11625927410758405314.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins487279064038532881.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-ask-all-potassium #39 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-ask-all-potassium@tmp/config5669899020600484018tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins9419837557465802439.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins9582739313974506209.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins4545628951590549012.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash /tmp/jenkins14773077984881048355.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH DEBUG: total: 1.6500000000000001 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-ask-all-potassium] $ /bin/bash -l /tmp/jenkins15902634794034269385.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-ask-all-potassium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-6BvC from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-6BvC/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-potassium/39/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-7771.novalocal 4.18.0-547.el8.x86_64 #1 SMP Wed Mar 20 00:35:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2800.000 BogoMIPS: 5600.00 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 9.5G 31G 24% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 620 4658 19 2419 6780 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:f3:3a:0c brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.171.237/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 70738sec preferred_lft 70738sec inet6 fe80::f816:3eff:fef3:3a0c/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-547.el8.x86_64 (centos-stream-8-robot-8eca76b2-cb40-4fba-ac9e-845c8a03a7a7.noval) 04/14/2024 _x86_64_ (2 CPU) 12:08:39 LINUX RESTART (2 CPU) 12:09:01 PM tps rtps wtps bread/s bwrtn/s 12:10:01 PM 161.01 103.73 57.28 12814.80 38690.14 12:11:01 PM 113.64 6.96 106.68 1304.20 8831.66 12:12:01 PM 45.76 0.70 45.06 50.52 5613.51 12:13:01 PM 13.76 0.88 12.88 123.40 558.34 12:14:01 PM 61.34 2.72 58.62 406.60 7696.63 12:15:01 PM 5.56 0.00 5.56 0.00 310.81 12:16:01 PM 1.83 0.00 1.83 0.00 91.43 12:17:01 PM 0.35 0.00 0.35 0.00 20.34 12:18:01 PM 0.30 0.00 0.30 0.00 14.68 12:19:01 PM 0.32 0.00 0.32 0.00 16.29 12:20:01 PM 0.27 0.00 0.27 0.00 16.45 12:21:01 PM 0.32 0.00 0.32 0.00 9.26 12:22:01 PM 0.33 0.03 0.30 1.87 27.03 12:23:01 PM 0.40 0.00 0.40 0.00 7.61 12:24:01 PM 1.43 0.03 1.40 0.27 33.31 12:25:01 PM 0.57 0.03 0.53 1.33 10.56 12:26:01 PM 0.12 0.00 0.12 0.00 0.93 12:27:01 PM 0.17 0.00 0.17 0.00 4.40 12:28:01 PM 0.15 0.00 0.15 0.00 1.77 12:29:01 PM 0.25 0.00 0.25 0.00 3.55 12:30:01 PM 0.23 0.00 0.23 0.00 10.83 12:31:01 PM 0.18 0.00 0.18 0.00 6.86 12:32:01 PM 0.30 0.00 0.30 0.00 4.53 12:33:01 PM 0.22 0.02 0.20 0.13 4.07 12:34:01 PM 0.38 0.00 0.38 0.00 9.70 12:35:01 PM 0.38 0.00 0.38 0.00 5.48 12:36:01 PM 0.23 0.00 0.23 0.00 7.36 12:37:01 PM 0.13 0.00 0.13 0.00 4.53 12:38:01 PM 0.13 0.00 0.13 0.00 7.33 12:39:01 PM 0.22 0.00 0.22 0.00 8.18 12:40:01 PM 0.20 0.00 0.20 0.00 3.22 12:41:01 PM 0.28 0.00 0.28 0.00 2.93 12:42:01 PM 0.27 0.00 0.27 0.00 9.90 12:43:01 PM 0.33 0.00 0.33 0.00 3.70 12:44:01 PM 0.30 0.00 0.30 0.00 7.27 12:45:01 PM 0.23 0.00 0.23 0.00 14.05 12:46:01 PM 0.17 0.00 0.17 0.00 8.42 12:47:01 PM 0.18 0.00 0.18 0.00 18.78 12:48:01 PM 0.13 0.00 0.13 0.00 10.41 12:49:01 PM 0.38 0.00 0.38 0.00 19.28 12:50:02 PM 0.23 0.00 0.23 0.00 16.03 12:51:01 PM 0.20 0.00 0.20 0.00 23.28 12:52:01 PM 0.23 0.00 0.23 0.00 5.88 12:53:01 PM 0.10 0.00 0.10 0.00 0.78 12:54:01 PM 0.23 0.00 0.23 0.00 5.57 12:55:01 PM 0.25 0.00 0.25 0.00 3.88 12:56:01 PM 0.23 0.00 0.23 0.00 3.03 12:57:01 PM 0.22 0.00 0.22 0.00 5.10 12:58:01 PM 0.10 0.00 0.10 0.00 0.72 12:59:01 PM 0.18 0.00 0.18 0.00 9.18 01:00:00 PM 8.86 6.66 2.21 573.28 2763.91 01:00:01 PM 0.00 0.00 0.00 0.00 0.00 01:01:01 PM 16.41 10.26 6.15 150.91 3293.03 01:02:01 PM 1.15 0.07 1.08 1.73 20.54 01:03:01 PM 0.20 0.00 0.20 0.00 4.03 01:04:01 PM 0.22 0.00 0.22 0.00 3.40 01:05:01 PM 0.30 0.00 0.30 0.00 5.16 01:06:01 PM 0.13 0.00 0.13 0.00 3.05 01:07:01 PM 0.13 0.00 0.13 0.00 5.98 01:08:01 PM 0.12 0.00 0.12 0.00 1.17 01:09:01 PM 0.33 0.00 0.33 0.00 8.18 01:10:01 PM 0.43 0.00 0.43 0.00 10.30 01:11:01 PM 0.45 0.00 0.45 0.00 5.48 01:12:01 PM 0.35 0.00 0.35 0.00 12.11 01:13:01 PM 0.15 0.00 0.15 0.00 2.70 01:14:01 PM 0.18 0.00 0.18 0.00 16.53 01:15:01 PM 0.27 0.00 0.27 0.00 18.01 01:16:01 PM 0.27 0.00 0.27 0.00 10.56 01:17:01 PM 0.32 0.00 0.32 0.00 16.96 01:18:01 PM 0.38 0.00 0.38 0.00 18.54 01:19:01 PM 0.52 0.00 0.52 0.00 23.21 01:20:01 PM 0.35 0.00 0.35 0.00 14.80 01:21:01 PM 0.25 0.00 0.25 0.00 4.27 01:22:01 PM 0.12 0.00 0.12 0.00 0.78 01:23:01 PM 0.23 0.00 0.23 0.00 5.57 01:24:01 PM 0.18 0.00 0.18 0.00 2.23 01:25:01 PM 0.27 0.00 0.27 0.00 6.57 01:26:01 PM 0.18 0.00 0.18 0.00 1.72 01:27:01 PM 0.13 0.00 0.13 0.00 7.06 01:28:01 PM 0.15 0.00 0.15 0.00 8.13 01:29:01 PM 0.23 0.00 0.23 0.00 3.72 01:30:01 PM 0.20 0.00 0.20 0.00 3.90 01:31:01 PM 0.30 0.00 0.30 0.00 5.13 01:32:01 PM 0.73 0.30 0.43 6.40 10.91 01:33:01 PM 0.73 0.00 0.73 0.00 18.43 01:34:01 PM 0.27 0.00 0.27 0.00 9.15 01:35:01 PM 0.25 0.00 0.25 0.00 9.93 01:36:01 PM 0.28 0.00 0.28 0.00 6.45 01:37:01 PM 0.33 0.00 0.33 0.00 8.42 01:38:01 PM 0.28 0.00 0.28 0.00 3.42 01:39:01 PM 0.38 0.00 0.38 0.00 10.26 01:40:01 PM 0.43 0.00 0.43 0.00 6.41 01:41:01 PM 0.42 0.00 0.42 0.00 8.17 01:42:01 PM 0.15 0.00 0.15 0.00 3.10 01:43:01 PM 0.25 0.00 0.25 0.00 18.78 01:44:01 PM 0.27 0.00 0.27 0.00 11.05 01:45:01 PM 0.22 0.00 0.22 0.00 16.03 01:46:01 PM 0.20 0.00 0.20 0.00 17.73 01:47:01 PM 0.17 0.00 0.17 0.00 11.18 01:48:01 PM 0.15 0.00 0.15 0.00 14.53 01:49:01 PM 0.23 0.00 0.23 0.00 21.94 01:50:01 PM 0.43 0.00 0.43 0.00 6.11 01:51:01 PM 0.52 0.00 0.52 0.00 8.93 01:52:01 PM 0.35 0.00 0.35 0.00 3.48 01:53:01 PM 0.45 0.00 0.45 0.00 6.63 01:54:01 PM 0.40 0.00 0.40 0.00 6.78 01:55:01 PM 0.43 0.00 0.43 0.00 5.88 01:56:01 PM 0.23 0.00 0.23 0.00 8.11 01:57:01 PM 0.12 0.00 0.12 0.00 2.67 01:58:01 PM 0.37 0.00 0.37 0.00 15.41 01:59:01 PM 0.25 0.00 0.25 0.00 3.57 02:00:01 PM 0.20 0.00 0.20 0.00 3.08 02:01:02 PM 0.22 0.00 0.22 0.00 5.13 02:02:01 PM 0.27 0.00 0.27 0.00 4.59 02:03:01 PM 0.18 0.00 0.18 0.00 3.75 02:04:01 PM 0.23 0.00 0.23 0.00 8.18 02:05:01 PM 0.20 0.00 0.20 0.00 3.12 02:06:01 PM 0.20 0.00 0.20 0.00 3.80 02:07:01 PM 0.18 0.00 0.18 0.00 2.97 02:08:01 PM 0.30 0.00 0.30 0.00 8.10 02:09:01 PM 0.38 0.00 0.38 0.00 5.98 02:10:01 PM 0.33 0.00 0.33 0.00 12.68 02:11:01 PM 0.18 0.00 0.18 0.00 12.41 02:12:01 PM 0.37 0.00 0.37 0.00 18.63 02:13:01 PM 0.30 0.00 0.30 0.00 12.25 02:14:01 PM 0.17 0.00 0.17 0.00 14.11 02:15:01 PM 0.27 0.00 0.27 0.00 17.71 02:16:01 PM 0.28 0.00 0.28 0.00 18.10 02:17:01 PM 0.23 0.00 0.23 0.00 19.53 02:18:01 PM 0.32 0.00 0.32 0.00 9.36 02:19:01 PM 0.93 0.00 0.93 0.00 15.26 02:20:01 PM 0.28 0.00 0.28 0.00 7.35 02:21:01 PM 0.27 0.00 0.27 0.00 3.37 02:22:01 PM 0.22 0.00 0.22 0.00 2.97 02:23:01 PM 0.17 0.00 0.17 0.00 4.42 02:24:01 PM 0.13 0.00 0.13 0.00 0.88 02:25:01 PM 0.25 0.00 0.25 0.00 11.86 02:26:01 PM 0.32 0.00 0.32 0.00 8.65 02:27:01 PM 0.33 0.00 0.33 0.00 4.08 02:28:01 PM 0.27 0.00 0.27 0.00 4.45 02:29:01 PM 0.28 0.00 0.28 0.00 4.52 02:30:01 PM 0.28 0.00 0.28 0.00 7.88 02:31:01 PM 0.17 0.00 0.17 0.00 2.97 02:32:01 PM 0.20 0.00 0.20 0.00 7.87 02:33:01 PM 0.12 0.00 0.12 0.00 1.30 02:34:01 PM 0.25 0.00 0.25 0.00 9.46 02:35:01 PM 0.25 0.00 0.25 0.00 11.21 02:36:01 PM 0.27 0.00 0.27 0.00 17.18 02:37:01 PM 0.18 0.00 0.18 0.00 15.88 02:38:01 PM 0.15 0.00 0.15 0.00 13.76 02:39:01 PM 0.18 0.00 0.18 0.00 7.75 02:40:01 PM 0.22 0.00 0.22 0.00 17.90 02:41:01 PM 0.25 0.00 0.25 0.00 23.53 02:42:01 PM 0.15 0.00 0.15 0.00 2.38 02:43:01 PM 0.20 0.00 0.20 0.00 2.25 02:44:01 PM 0.25 0.00 0.25 0.00 6.27 02:45:01 PM 0.25 0.00 0.25 0.00 4.02 02:46:01 PM 0.13 0.00 0.13 0.00 3.48 02:47:01 PM 0.15 0.00 0.15 0.00 1.85 02:48:01 PM 0.13 0.00 0.13 0.00 6.65 02:49:01 PM 0.20 0.00 0.20 0.00 4.75 02:50:01 PM 0.23 0.00 0.23 0.00 8.83 02:51:01 PM 0.40 0.00 0.40 0.00 5.17 02:52:01 PM 0.23 0.00 0.23 0.00 4.98 02:53:01 PM 0.18 0.00 0.18 0.00 5.75 02:54:01 PM 0.25 0.00 0.25 0.00 6.23 02:55:01 PM 0.42 0.00 0.42 0.00 10.58 02:56:01 PM 0.37 0.00 0.37 0.00 4.12 02:57:01 PM 0.23 0.00 0.23 0.00 5.75 02:58:01 PM 0.17 0.00 0.17 0.00 11.48 02:59:01 PM 0.23 0.00 0.23 0.00 10.40 03:00:01 PM 0.33 0.00 0.33 0.00 19.08 03:01:01 PM 0.23 0.00 0.23 0.00 16.31 03:02:01 PM 0.17 0.00 0.17 0.00 13.99 03:03:01 PM 0.12 0.00 0.12 0.00 8.00 03:04:01 PM 0.32 0.00 0.32 0.00 25.01 03:05:01 PM 0.25 0.00 0.25 0.00 12.81 03:06:01 PM 0.13 0.00 0.13 0.00 1.32 03:07:01 PM 0.12 0.00 0.12 0.00 3.45 03:08:01 PM 0.17 0.00 0.17 0.00 1.77 03:09:01 PM 0.18 0.00 0.18 0.00 1.85 03:10:02 PM 0.33 0.00 0.33 0.00 7.42 03:11:01 PM 0.25 0.00 0.25 0.00 2.88 03:12:01 PM 0.23 0.00 0.23 0.00 8.57 03:13:01 PM 0.15 0.00 0.15 0.00 7.48 03:14:01 PM 0.20 0.00 0.20 0.00 3.55 03:15:01 PM 0.25 0.00 0.25 0.00 3.90 03:16:01 PM 0.18 0.00 0.18 0.00 3.63 03:17:01 PM 0.12 0.00 0.12 0.00 2.13 03:18:01 PM 0.20 0.00 0.20 0.00 6.41 03:19:01 PM 0.35 0.00 0.35 0.00 4.05 03:20:01 PM 0.50 0.00 0.50 0.00 13.00 03:21:01 PM 0.28 0.00 0.28 0.00 9.65 03:22:01 PM 0.28 0.00 0.28 0.00 19.50 03:23:01 PM 0.15 0.00 0.15 0.00 13.76 03:24:01 PM 0.17 0.00 0.17 0.00 7.83 03:25:01 PM 0.32 0.00 0.32 0.00 19.11 03:26:01 PM 0.18 0.00 0.18 0.00 16.11 03:27:01 PM 0.17 0.00 0.17 0.00 21.58 03:28:01 PM 0.28 0.00 0.28 0.00 6.35 03:29:01 PM 0.20 0.00 0.20 0.00 2.27 03:30:01 PM 0.27 0.00 0.27 0.00 7.10 03:31:01 PM 0.23 0.00 0.23 0.00 3.70 03:32:01 PM 0.20 0.00 0.20 0.00 5.50 03:33:01 PM 0.15 0.00 0.15 0.00 1.88 03:34:01 PM 0.18 0.00 0.18 0.00 1.28 03:35:01 PM 0.50 0.00 0.50 0.00 17.50 03:36:01 PM 0.23 0.00 0.23 0.00 8.30 03:37:01 PM 0.13 0.00 0.13 0.00 14.26 03:38:01 PM 0.13 0.00 0.13 0.00 14.80 03:39:01 PM 0.13 0.00 0.13 0.00 7.05 03:40:01 PM 0.25 0.00 0.25 0.00 16.84 03:41:01 PM 0.18 0.00 0.18 0.00 15.93 03:42:01 PM 0.32 0.00 0.32 0.00 28.56 03:43:01 PM 0.23 0.00 0.23 0.00 5.75 03:44:01 PM 0.35 0.00 0.35 0.00 3.78 03:45:01 PM 0.43 0.00 0.43 0.00 8.26 03:46:01 PM 0.35 0.00 0.35 0.00 3.87 03:47:01 PM 0.37 0.00 0.37 0.00 6.78 03:48:01 PM 0.12 0.00 0.12 0.00 0.82 03:49:01 PM 0.18 0.00 0.18 0.00 1.70 03:50:01 PM 0.18 0.00 0.18 0.00 8.95 03:51:01 PM 0.35 0.00 0.35 0.00 9.10 03:52:01 PM 0.23 0.00 0.23 0.00 14.28 03:53:01 PM 0.13 0.00 0.13 0.00 15.06 03:54:01 PM 0.25 0.00 0.25 0.00 15.95 03:55:01 PM 0.25 0.00 0.25 0.00 12.95 03:56:01 PM 0.15 0.00 0.15 0.00 15.06 03:57:01 PM 0.13 0.00 0.13 0.00 13.73 03:58:01 PM 0.22 0.00 0.22 0.00 20.68 03:59:01 PM 0.35 0.00 0.35 0.00 8.20 04:00:01 PM 0.20 0.00 0.20 0.00 3.10 04:01:01 PM 0.20 0.00 0.20 0.00 4.33 04:02:01 PM 0.20 0.00 0.20 0.00 2.82 04:03:01 PM 0.25 0.00 0.25 0.00 5.72 04:04:01 PM 0.25 0.00 0.25 0.00 3.92 04:05:01 PM 0.22 0.00 0.22 0.00 3.22 04:06:01 PM 0.15 0.00 0.15 0.00 11.33 04:07:01 PM 0.13 0.00 0.13 0.00 11.20 04:08:01 PM 0.12 0.00 0.12 0.00 7.73 04:09:01 PM 0.23 0.00 0.23 0.00 14.80 04:10:01 PM 0.25 0.00 0.25 0.00 17.66 04:11:01 PM 0.28 0.00 0.28 0.00 16.01 04:12:01 PM 0.22 0.00 0.22 0.00 10.81 04:13:01 PM 0.13 0.00 0.13 0.00 17.33 04:14:01 PM 0.23 0.00 0.23 0.00 17.68 04:15:01 PM 0.20 0.00 0.20 0.00 3.75 04:16:01 PM 0.32 0.03 0.28 1.07 6.48 04:17:01 PM 1.98 0.00 1.98 0.00 38.21 04:18:01 PM 0.12 0.00 0.12 0.00 0.78 04:19:01 PM 0.32 0.00 0.32 0.00 6.91 04:20:02 PM 0.23 0.00 0.23 0.00 3.50 04:21:01 PM 0.22 0.00 0.22 0.00 7.64 04:22:01 PM 0.18 0.00 0.18 0.00 16.13 04:23:01 PM 0.13 0.00 0.13 0.00 13.86 04:24:01 PM 0.20 0.00 0.20 0.00 15.81 04:25:01 PM 0.23 0.00 0.23 0.00 15.68 04:26:01 PM 0.27 0.00 0.27 0.00 15.71 04:27:01 PM 0.20 0.00 0.20 0.00 26.67 04:28:01 PM 0.33 0.00 0.33 0.00 3.67 04:29:01 PM 18.49 0.32 18.18 44.79 2662.31 Average: 1.97 0.51 1.46 59.54 280.16 12:09:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:10:01 PM 5537624 7048260 2344812 29.75 2688 1703948 742440 8.31 183956 1880720 74860 12:11:01 PM 5248304 7056928 2634132 33.42 2688 1985908 676652 7.58 211480 2081076 112056 12:12:01 PM 5222016 7050524 2660420 33.75 2688 2005712 684596 7.67 229316 2087884 28 12:13:01 PM 5180836 7048728 2701600 34.27 2688 2042596 669824 7.50 250872 2100240 31592 12:14:01 PM 5006868 7051688 2875568 36.48 2688 2214248 652636 7.31 266780 2231560 2976 12:15:01 PM 4971172 7016636 2911264 36.93 2688 2214876 721636 8.08 266956 2270904 620 12:16:01 PM 4966816 7012704 2915620 36.99 2688 2215300 721636 8.08 266956 2275408 196 12:17:01 PM 4965840 7012084 2916596 37.00 2688 2215664 721636 8.08 266956 2276660 64 12:18:01 PM 4963928 7010528 2918508 37.03 2688 2216020 721636 8.08 266956 2278544 72 12:19:01 PM 4962676 7009636 2919760 37.04 2688 2216372 721636 8.08 266956 2279660 48 12:20:01 PM 4960692 7008008 2921744 37.07 2688 2216736 738088 8.26 266956 2281392 24 12:21:01 PM 4959580 7007264 2922856 37.08 2688 2217080 717472 8.03 266956 2282740 184 12:22:01 PM 4956856 7005216 2925580 37.12 2688 2217756 717472 8.03 267216 2285040 96 12:23:01 PM 4958560 7006908 2923876 37.09 2688 2217752 717472 8.03 267696 2283324 4 12:24:01 PM 4958492 7006832 2923944 37.09 2688 2217752 740692 8.29 267748 2283632 0 12:25:01 PM 4958224 7006684 2924212 37.10 2688 2217872 740692 8.29 267752 2283856 8 12:26:01 PM 4958372 7006832 2924064 37.10 2688 2217872 740692 8.29 267752 2283788 8 12:27:01 PM 4958020 7006560 2924416 37.10 2688 2217952 740692 8.29 267752 2284360 4 12:28:01 PM 4958052 7006596 2924384 37.10 2688 2217956 740692 8.29 267752 2284252 8 12:29:01 PM 4956696 7005408 2925740 37.12 2688 2218124 725132 8.12 267900 2285468 176 12:30:01 PM 4955820 7004604 2926616 37.13 2688 2218196 746012 8.35 267900 2285992 24 12:31:01 PM 4955484 7004404 2926952 37.13 2688 2218332 721096 8.07 267912 2286464 4 12:32:01 PM 4955304 7004224 2927132 37.13 2688 2218332 721096 8.07 267912 2286600 4 12:33:01 PM 4954004 7003128 2928432 37.15 2688 2218536 721096 8.07 267916 2287956 144 12:34:01 PM 4954076 7003200 2928360 37.15 2688 2218536 721096 8.07 267916 2287816 4 12:35:01 PM 4954012 7003136 2928424 37.15 2688 2218536 721096 8.07 267916 2287768 4 12:36:01 PM 4953976 7003248 2928460 37.15 2688 2218684 721096 8.07 267916 2287964 4 12:37:01 PM 4954016 7003392 2928420 37.15 2688 2218788 721096 8.07 267916 2288068 16 12:38:01 PM 4954028 7003588 2928408 37.15 2688 2218972 721096 8.07 267916 2288136 4 12:39:01 PM 4953656 7003364 2928780 37.16 2688 2219120 721096 8.07 267916 2288288 4 12:40:01 PM 4953112 7002824 2929324 37.16 2688 2219124 736944 8.25 267916 2288592 4 12:41:01 PM 4953368 7003136 2929068 37.16 2688 2219180 736944 8.25 267916 2288500 68 12:42:01 PM 4953372 7003280 2929064 37.16 2688 2219320 736944 8.25 267920 2288484 4 12:43:01 PM 4953324 7003232 2929112 37.16 2688 2219320 736944 8.25 267920 2288484 4 12:44:01 PM 4953276 7003328 2929160 37.16 2688 2219464 736944 8.25 267920 2288656 24 12:45:01 PM 4952780 7003208 2929656 37.17 2688 2219840 736944 8.25 267920 2289256 80 12:46:01 PM 4952424 7003204 2930012 37.17 2688 2220192 736944 8.25 267920 2289524 216 12:47:01 PM 4951888 7003012 2930548 37.18 2688 2220544 736944 8.25 267920 2290168 80 12:48:01 PM 4951612 7003096 2930824 37.18 2688 2220896 736944 8.25 267920 2290340 160 12:49:01 PM 4951488 7003328 2930948 37.18 2688 2221260 736944 8.25 267920 2290628 96 12:50:02 PM 4950508 7002704 2931928 37.20 2688 2221616 736944 8.25 267920 2291536 72 12:51:01 PM 4950132 7002924 2932304 37.20 2688 2222212 736944 8.25 267920 2291744 24 12:52:01 PM 4950072 7002944 2932364 37.20 2688 2222284 736944 8.25 267920 2291828 4 12:53:01 PM 4950044 7002920 2932392 37.20 2688 2222288 736944 8.25 267920 2291948 4 12:54:01 PM 4950052 7003004 2932384 37.20 2688 2222364 736944 8.25 267920 2291908 4 12:55:01 PM 4949976 7002928 2932460 37.20 2688 2222364 736944 8.25 267920 2291976 4 12:56:01 PM 4950092 7003128 2932344 37.20 2688 2222448 736944 8.25 267920 2291992 88 12:57:01 PM 4950040 7003076 2932396 37.20 2688 2222448 736944 8.25 267920 2291992 8 12:58:01 PM 4949864 7003064 2932572 37.20 2688 2222612 720424 8.07 267920 2292152 172 12:59:01 PM 4949680 7002948 2932756 37.21 2688 2222680 720424 8.07 267920 2292220 16 01:00:00 PM 4596360 6818536 3286076 41.69 2688 2391404 945620 10.59 348768 2560260 70808 01:00:01 PM 4580416 6811404 3302020 41.89 2688 2400324 942288 10.55 348888 2575608 79732 01:01:01 PM 4753268 6998008 3129168 39.70 2688 2413900 741564 8.30 381116 2371600 8 01:02:01 PM 4754380 6999188 3128056 39.68 2688 2413968 741564 8.30 381200 2370948 4 01:03:01 PM 4754332 6999244 3128104 39.68 2688 2414072 741564 8.30 381200 2370676 48 01:04:01 PM 4754368 6999284 3128068 39.68 2688 2414076 741564 8.30 381200 2370680 4 01:05:01 PM 4755144 7000096 3127292 39.67 2688 2414112 741564 8.30 381200 2370784 52 01:06:01 PM 4754888 6999992 3127548 39.68 2688 2414264 741564 8.30 381200 2370992 144 01:07:01 PM 4754968 7000076 3127468 39.68 2688 2414268 741564 8.30 381200 2370880 4 01:08:01 PM 4755128 7000292 3127308 39.67 2688 2414324 741564 8.30 381200 2371044 64 01:09:01 PM 4754788 7000144 3127648 39.68 2688 2414516 741564 8.30 381200 2371136 144 01:10:01 PM 4754404 6999764 3128032 39.68 2688 2414520 725504 8.12 381200 2371440 4 01:11:01 PM 4754848 7000212 3127588 39.68 2688 2414524 725504 8.12 381200 2371144 4 01:12:01 PM 4754480 7000132 3127956 39.68 2688 2414812 725504 8.12 381200 2371556 40 01:13:01 PM 4754152 7000020 3128284 39.69 2688 2415036 744136 8.33 381200 2371808 216 01:14:01 PM 4753740 6999952 3128696 39.69 2688 2415380 744136 8.33 381200 2372148 112 01:15:01 PM 4753640 7000208 3128796 39.69 2688 2415728 744136 8.33 381200 2372448 40 01:16:01 PM 4753436 7000360 3129000 39.70 2688 2416092 744136 8.33 381200 2372740 172 01:17:01 PM 4752900 7000164 3129536 39.70 2688 2416432 744136 8.33 381200 2373080 108 01:18:01 PM 4752456 7000080 3129980 39.71 2688 2416792 744136 8.33 381200 2373576 24 01:19:01 PM 4751688 7000028 3130748 39.72 2688 2417500 744136 8.33 381200 2374364 184 01:20:01 PM 4750964 6999428 3131472 39.73 2688 2417624 744136 8.33 381200 2374720 8 01:21:01 PM 4751412 6999880 3131024 39.72 2688 2417628 744136 8.33 381200 2374768 4 01:22:01 PM 4751388 6999932 3131048 39.72 2688 2417704 744136 8.33 381200 2374712 88 01:23:01 PM 4751424 6999968 3131012 39.72 2688 2417704 744136 8.33 381200 2374712 4 01:24:01 PM 4751132 6999688 3131304 39.73 2688 2417716 744136 8.33 381200 2374912 20 01:25:01 PM 4751080 6999712 3131356 39.73 2688 2417792 744136 8.33 381208 2374860 8 01:26:01 PM 4751320 6999952 3131116 39.72 2688 2417792 744136 8.33 381200 2374836 8 01:27:01 PM 4750076 6998896 3132360 39.74 2688 2417980 720684 8.07 381200 2375748 24 01:28:01 PM 4749704 6998720 3132732 39.74 2688 2418176 720684 8.07 381208 2376364 4 01:29:01 PM 4749536 6998552 3132900 39.75 2688 2418176 736064 8.24 381208 2376364 4 01:30:01 PM 4749036 6998096 3133400 39.75 2688 2418220 753948 8.44 381208 2376836 52 01:31:01 PM 4749116 6998340 3133320 39.75 2688 2418380 734492 8.22 381216 2376704 152 01:32:01 PM 4749048 6998472 3133388 39.75 2688 2418580 734492 8.22 381352 2376792 12 01:33:01 PM 4748724 6998196 3133712 39.76 2688 2418628 734492 8.22 381352 2376924 56 01:34:01 PM 4748812 6998472 3133624 39.75 2688 2418816 734492 8.22 381352 2376916 92 01:35:01 PM 4748716 6998492 3133720 39.76 2688 2418932 734492 8.22 381352 2377216 16 01:36:01 PM 4748624 6998632 3133812 39.76 2688 2419180 734492 8.22 381352 2377384 160 01:37:01 PM 4748636 6998660 3133800 39.76 2688 2419180 734492 8.22 381352 2377400 4 01:38:01 PM 4747908 6997936 3134528 39.77 2688 2419184 734492 8.22 381352 2377696 4 01:39:01 PM 4748376 6998600 3134060 39.76 2688 2419380 734492 8.22 381360 2377476 4 01:40:01 PM 4747748 6997972 3134688 39.77 2688 2419380 750884 8.41 381360 2377892 4 01:41:01 PM 4748220 6998544 3134216 39.76 2688 2419480 731356 8.19 381360 2377576 4 01:42:01 PM 4747728 6998260 3134708 39.77 2688 2419696 731356 8.19 381360 2377932 176 01:43:01 PM 4747456 6998348 3134980 39.77 2688 2420048 731356 8.19 381360 2378384 48 01:44:01 PM 4747196 6998440 3135240 39.78 2688 2420408 731356 8.19 381360 2378544 192 01:45:01 PM 4746776 6998380 3135660 39.78 2688 2420760 731356 8.19 381360 2378992 164 01:46:01 PM 4746560 6998524 3135876 39.78 2688 2421120 731356 8.19 381360 2379328 32 01:47:01 PM 4745840 6998156 3136596 39.79 2688 2421472 731356 8.19 381360 2379996 128 01:48:01 PM 4745376 6998212 3137060 39.80 2688 2421988 731356 8.19 381360 2380244 240 01:49:01 PM 4745264 6998452 3137172 39.80 2688 2422340 746748 8.36 381360 2380620 4 01:50:01 PM 4744808 6997996 3137628 39.81 2688 2422340 732804 8.21 381360 2380920 4 01:51:01 PM 4745020 6998292 3137416 39.80 2688 2422424 732804 8.21 381360 2380840 4 01:52:01 PM 4744868 6998140 3137568 39.80 2688 2422424 732804 8.21 381388 2380928 4 01:53:01 PM 4745276 6998548 3137160 39.80 2688 2422424 732804 8.21 381388 2380676 4 01:54:01 PM 4745004 6998352 3137432 39.80 2688 2422500 732804 8.21 381388 2380756 4 01:55:01 PM 4744924 6998276 3137512 39.80 2688 2422504 732804 8.21 381388 2380828 4 01:56:01 PM 4744940 6998476 3137496 39.80 2688 2422688 732804 8.21 381388 2380936 24 01:57:01 PM 4744440 6998168 3137996 39.81 2688 2422880 732804 8.21 381388 2381268 172 01:58:01 PM 4744532 6998424 3137904 39.81 2688 2423044 732804 8.21 381388 2381308 8 01:59:01 PM 4744412 6998304 3138024 39.81 2688 2423044 732804 8.21 381388 2381308 4 02:00:01 PM 4744056 6998000 3138380 39.81 2688 2423096 724628 8.11 381388 2381652 60 02:01:02 PM 4742464 6996464 3139972 39.84 2688 2423148 724628 8.11 381388 2382588 4 02:02:01 PM 4744240 6998244 3138196 39.81 2688 2423152 724628 8.11 381392 2381404 4 02:03:01 PM 4744144 6998208 3138292 39.81 2688 2423212 740008 8.29 381392 2381468 4 02:04:01 PM 4744096 6998304 3138340 39.81 2688 2423356 740008 8.29 381392 2381620 4 02:05:01 PM 4744056 6998264 3138380 39.81 2688 2423356 740008 8.29 381392 2381688 4 02:06:01 PM 4743992 6998308 3138444 39.82 2688 2423464 740008 8.29 381392 2381720 48 02:07:01 PM 4743944 6998408 3138492 39.82 2688 2423612 740008 8.29 381392 2381888 148 02:08:01 PM 4743944 6998408 3138492 39.82 2688 2423612 740008 8.29 381392 2381888 4 02:09:01 PM 4743632 6998164 3138804 39.82 2688 2423680 740008 8.29 381392 2381940 16 02:10:01 PM 4743232 6998004 3139204 39.83 2688 2423920 724628 8.11 381392 2382588 16 02:11:01 PM 4743100 6998232 3139336 39.83 2688 2424280 724628 8.11 381392 2382656 48 02:12:01 PM 4742672 6998160 3139764 39.83 2688 2424636 724628 8.11 381392 2383012 4 02:13:01 PM 4743100 6998948 3139336 39.83 2688 2424996 724628 8.11 381388 2382980 152 02:14:01 PM 4742548 6998748 3139888 39.83 2688 2425348 724628 8.11 381388 2383332 116 02:15:01 PM 4741916 6998468 3140520 39.84 2688 2425708 724628 8.11 381388 2383752 80 02:16:01 PM 4742036 6998956 3140400 39.84 2688 2426068 724628 8.11 381388 2384052 4 02:17:01 PM 4741140 6998668 3141296 39.85 2688 2426684 724628 8.11 381388 2384660 140 02:18:01 PM 4740596 6998204 3141840 39.86 2688 2426756 724112 8.11 381388 2385112 4 02:19:01 PM 4740692 6998300 3141744 39.86 2688 2426756 741496 8.30 390652 2375772 4 02:20:01 PM 4740588 6998280 3141848 39.86 2688 2426840 732284 8.20 390652 2375904 4 02:21:01 PM 4740812 6998508 3141624 39.86 2688 2426844 732284 8.20 390652 2375756 4 02:22:01 PM 4740840 6998616 3141596 39.86 2688 2426924 732284 8.20 390652 2375836 88 02:23:01 PM 4740864 6998640 3141572 39.86 2688 2426924 732284 8.20 390652 2375784 4 02:24:01 PM 4740708 6998620 3141728 39.86 2688 2427060 732284 8.20 390652 2375804 148 02:25:01 PM 4740708 6998704 3141728 39.86 2688 2427144 732284 8.20 390652 2376084 4 02:26:01 PM 4740628 6998776 3141808 39.86 2688 2427296 732284 8.20 390660 2376044 4 02:27:01 PM 4740492 6998640 3141944 39.86 2688 2427296 732284 8.20 390660 2376044 4 02:28:01 PM 4740472 6998680 3141964 39.86 2688 2427356 732284 8.20 390660 2376220 16 02:29:01 PM 4740452 6998752 3141984 39.86 2688 2427448 732284 8.20 390660 2376196 60 02:30:01 PM 4739944 6998308 3142492 39.87 2688 2427512 724172 8.11 390660 2376560 16 02:31:01 PM 4740196 6998752 3142240 39.86 2688 2427704 724172 8.11 390664 2376448 156 02:32:01 PM 4739780 6998336 3142656 39.87 2688 2427704 724172 8.11 390668 2376696 12 02:33:01 PM 4739676 6998336 3142760 39.87 2688 2427808 724172 8.11 390664 2376752 112 02:34:01 PM 4739976 6998808 3142460 39.87 2688 2427980 744380 8.33 390664 2376812 56 02:35:01 PM 4739520 6998716 3142916 39.87 2688 2428344 744380 8.33 390672 2377324 192 02:36:01 PM 4739040 6998588 3143396 39.88 2688 2428696 744380 8.33 390664 2377684 112 02:37:01 PM 4738872 6998772 3143564 39.88 2688 2429048 744380 8.33 390664 2378068 40 02:38:01 PM 4738396 6998648 3144040 39.89 2688 2429400 744380 8.33 390664 2378304 4 02:39:01 PM 4738008 6998612 3144428 39.89 2688 2429760 744380 8.33 390664 2378772 176 02:40:01 PM 4737108 6998076 3145328 39.90 2688 2430124 747356 8.37 390664 2379436 112 02:41:01 PM 4736892 6998416 3145544 39.91 2688 2430668 747356 8.37 390664 2379712 4 02:42:01 PM 4736920 6998448 3145516 39.91 2688 2430672 747356 8.37 390664 2379736 4 02:43:01 PM 4737008 6998536 3145428 39.90 2688 2430680 747356 8.37 390664 2379736 16 02:44:01 PM 4736944 6998552 3145492 39.91 2688 2430752 747356 8.37 390664 2379668 4 02:45:01 PM 4737072 6998684 3145364 39.90 2688 2430756 730492 8.18 390664 2379740 4 02:46:01 PM 4736984 6998672 3145452 39.90 2688 2430832 730492 8.18 390664 2379748 4 02:47:01 PM 4736744 6998432 3145692 39.91 2688 2430832 730492 8.18 390664 2380088 4 02:48:01 PM 4736632 6998500 3145804 39.91 2688 2431012 730492 8.18 390664 2379936 16 02:49:01 PM 4736200 6998244 3146236 39.91 2688 2431204 730492 8.18 390664 2380460 160 02:50:01 PM 4735512 6997572 3146924 39.92 2688 2431204 747060 8.36 390664 2381008 4 02:51:01 PM 4735808 6997872 3146628 39.92 2688 2431208 727604 8.15 390664 2380736 12 02:52:01 PM 4735508 6997680 3146928 39.92 2688 2431316 727604 8.15 390672 2380976 64 02:53:01 PM 4735640 6997888 3146796 39.92 2688 2431392 727604 8.15 390672 2380764 4 02:54:01 PM 4735724 6998076 3146712 39.92 2688 2431496 727604 8.15 390672 2380868 4 02:55:01 PM 4735568 6998064 3146868 39.92 2688 2431640 727604 8.15 390672 2380964 4 02:56:01 PM 4735644 6998144 3146792 39.92 2688 2431644 727604 8.15 390672 2380900 4 02:57:01 PM 4735576 6998204 3146860 39.92 2688 2431772 727604 8.15 390672 2381028 40 02:58:01 PM 4735228 6998140 3147208 39.93 2688 2432064 746848 8.36 390672 2381440 24 02:59:01 PM 4734840 6998116 3147596 39.93 2688 2432420 746848 8.36 390672 2381724 160 03:00:01 PM 4734220 6997848 3148216 39.94 2688 2432780 721300 8.08 390672 2382376 96 03:01:01 PM 4733308 6997296 3149128 39.95 2688 2433140 736976 8.25 390672 2383116 32 03:02:01 PM 4733816 6998148 3148620 39.94 2688 2433476 736976 8.25 390672 2382764 4 03:03:01 PM 4733408 6998100 3149028 39.95 2688 2433836 736976 8.25 390672 2383152 152 03:04:01 PM 4732492 6997848 3149944 39.96 2688 2434500 736976 8.25 390672 2384036 192 03:05:01 PM 4732508 6997948 3149928 39.96 2688 2434584 736976 8.25 390672 2384076 4 03:06:01 PM 4732468 6997908 3149968 39.96 2688 2434584 736976 8.25 390672 2384124 4 03:07:01 PM 4732432 6997952 3150004 39.96 2688 2434664 736976 8.25 390672 2384088 4 03:08:01 PM 4732624 6998148 3149812 39.96 2688 2434668 736976 8.25 390672 2384096 4 03:09:01 PM 4732376 6997976 3150060 39.96 2688 2434744 736976 8.25 390672 2384172 84 03:10:02 PM 4731952 6997552 3150484 39.97 2688 2434744 725312 8.12 390672 2384476 4 03:11:01 PM 4731996 6997728 3150440 39.97 2688 2434876 725312 8.12 390672 2384444 136 03:12:01 PM 4731912 6997732 3150524 39.97 2688 2434964 725312 8.12 390672 2384544 56 03:13:01 PM 4731848 6997816 3150588 39.97 2688 2435112 725312 8.12 390676 2384688 8 03:14:01 PM 4731952 6997920 3150484 39.97 2688 2435112 725312 8.12 390676 2384536 4 03:15:01 PM 4731836 6997860 3150600 39.97 2688 2435168 725312 8.12 390676 2384660 64 03:16:01 PM 4731948 6997984 3150488 39.97 2688 2435180 725312 8.12 390676 2384720 4 03:17:01 PM 4731612 6997812 3150824 39.97 2688 2435360 725312 8.12 390680 2384768 144 03:18:01 PM 4731564 6997780 3150872 39.97 2688 2435360 725312 8.12 390680 2384784 4 03:19:01 PM 4731684 6997904 3150752 39.97 2688 2435364 725312 8.12 390680 2384788 4 03:20:01 PM 4731072 6997500 3151364 39.98 2688 2435580 744396 8.33 390680 2385320 16 03:21:01 PM 4731160 6997952 3151276 39.98 2688 2435936 744396 8.33 390680 2385516 172 03:22:01 PM 4730748 6997892 3151688 39.98 2688 2436296 744396 8.33 390680 2385728 48 03:23:01 PM 4730452 6997956 3151984 39.99 2688 2436656 744396 8.33 390680 2386092 24 03:24:01 PM 4730200 6998064 3152236 39.99 2688 2437008 744396 8.33 390680 2386452 188 03:25:01 PM 4729692 6997916 3152744 40.00 2688 2437368 744396 8.33 390680 2386880 120 03:26:01 PM 4729468 6998036 3152968 40.00 2688 2437712 744396 8.33 390680 2387156 48 03:27:01 PM 4728776 6997964 3153660 40.01 2688 2438332 744396 8.33 390680 2387776 80 03:28:01 PM 4728728 6997916 3153708 40.01 2688 2438332 744396 8.33 390680 2387784 4 03:29:01 PM 4728672 6997860 3153764 40.01 2688 2438332 744396 8.33 390680 2387784 4 03:30:01 PM 4728280 6997548 3154156 40.01 2688 2438412 733504 8.21 390680 2388164 4 03:31:01 PM 4728696 6997964 3153740 40.01 2688 2438412 733504 8.21 390680 2387864 4 03:32:01 PM 4728524 6997876 3153912 40.01 2688 2438496 733504 8.21 390680 2388068 16 03:33:01 PM 4728256 6997608 3154180 40.02 2688 2438496 733504 8.21 390680 2388252 4 03:34:01 PM 4728500 6998016 3153936 40.01 2688 2438660 733504 8.21 390680 2388204 172 03:35:01 PM 4728120 6997808 3154316 40.02 2688 2438832 733504 8.21 390680 2388444 56 03:36:01 PM 4727712 6997648 3154724 40.02 2688 2439080 726152 8.13 390680 2388632 120 03:37:01 PM 4727548 6997832 3154888 40.02 2688 2439436 726152 8.13 390680 2388984 76 03:38:01 PM 4727252 6997900 3155184 40.03 2688 2439800 726152 8.13 390680 2389344 20 03:39:01 PM 4726900 6997892 3155536 40.03 2688 2440136 741864 8.31 390680 2389688 176 03:40:01 PM 4725764 6997116 3156672 40.05 2688 2440492 743068 8.32 390680 2390348 132 03:41:01 PM 4725864 6997576 3156572 40.05 2688 2440860 743068 8.32 390680 2390664 64 03:42:01 PM 4725148 6997552 3157288 40.05 2688 2441544 743068 8.32 390688 2391368 8 03:43:01 PM 4725184 6997696 3157252 40.05 2688 2441652 743068 8.32 390680 2391392 4 03:44:01 PM 4725296 6997808 3157140 40.05 2688 2441652 743068 8.32 390680 2391296 4 03:45:01 PM 4725128 6997716 3157308 40.05 2688 2441728 743068 8.32 390680 2391476 4 03:46:01 PM 4725124 6997712 3157312 40.06 2688 2441728 743068 8.32 390680 2391444 4 03:47:01 PM 4724620 6997292 3157816 40.06 2688 2441812 743068 8.32 390680 2391688 4 03:48:01 PM 4724976 6997648 3157460 40.06 2688 2441812 743068 8.32 390680 2391532 4 03:49:01 PM 4725068 6997740 3157368 40.06 2688 2441812 743068 8.32 390680 2391416 4 03:50:01 PM 4724404 6997284 3158032 40.06 2688 2442020 739172 8.28 390680 2392048 48 03:51:01 PM 4724404 6997440 3158032 40.06 2688 2442164 739172 8.28 390680 2391912 24 03:52:01 PM 4724200 6997648 3158236 40.07 2688 2442584 739172 8.28 390680 2392328 112 03:53:01 PM 4723220 6997016 3159216 40.08 2688 2442932 739172 8.28 390680 2393080 40 03:54:01 PM 4723712 6997852 3158724 40.07 2688 2443284 739172 8.28 390680 2392888 24 03:55:01 PM 4723200 6997704 3159236 40.08 2688 2443648 739172 8.28 390680 2393436 136 03:56:01 PM 4723052 6997912 3159384 40.08 2688 2443996 739172 8.28 390680 2393608 64 03:57:01 PM 4722376 6997592 3160060 40.09 2688 2444356 739172 8.28 390680 2394176 52 03:58:01 PM 4721732 6997548 3160704 40.10 2688 2444948 722676 8.09 390680 2394680 100 03:59:01 PM 4721764 6997580 3160672 40.10 2688 2444948 722676 8.09 390680 2394684 4 04:00:01 PM 4721376 6997200 3161060 40.10 2688 2444956 737588 8.26 390680 2395104 16 04:01:01 PM 4720896 6996796 3161540 40.11 2688 2445032 737588 8.26 390680 2395464 8 04:02:01 PM 4721816 6997720 3160620 40.10 2688 2445036 737588 8.26 390680 2394772 4 04:03:01 PM 4721060 6997044 3161376 40.11 2688 2445116 737588 8.26 390680 2395260 4 04:04:01 PM 4721688 6997672 3160748 40.10 2688 2445116 737588 8.26 390680 2394852 8 04:05:01 PM 4721220 6997372 3161216 40.10 2688 2445284 737588 8.26 390680 2395076 176 04:06:01 PM 4721424 6997748 3161012 40.10 2688 2445456 737588 8.26 390680 2395180 40 04:07:01 PM 4720956 6997556 3161480 40.11 2688 2445732 734560 8.22 390680 2395464 4 04:08:01 PM 4720616 6997568 3161820 40.11 2688 2446092 734560 8.22 390680 2395816 160 04:09:01 PM 4720464 6997768 3161972 40.11 2688 2446436 734560 8.22 390680 2396172 140 04:10:01 PM 4719340 6996988 3163096 40.13 2688 2446788 732552 8.20 390680 2396816 64 04:11:01 PM 4719452 6997468 3162984 40.13 2688 2447156 732552 8.20 390680 2397044 40 04:12:01 PM 4719156 6997528 3163280 40.13 2688 2447504 732552 8.20 390680 2397400 148 04:13:01 PM 4718432 6997480 3164004 40.14 2688 2448180 732552 8.20 390680 2398208 332 04:14:01 PM 4718660 6997812 3163776 40.14 2688 2448284 732552 8.20 390680 2398040 4 04:15:01 PM 4718124 6997276 3164312 40.14 2688 2448284 732552 8.20 390680 2398292 12 04:16:01 PM 4717860 6997136 3164576 40.15 2688 2448404 734216 8.22 395148 2394140 348 04:17:01 PM 4718040 6997320 3164396 40.14 2688 2448408 734216 8.22 395148 2393872 8 04:18:01 PM 4718232 6997592 3164204 40.14 2688 2448488 734216 8.22 395148 2393792 88 04:19:01 PM 4718152 6997512 3164284 40.14 2688 2448488 734216 8.22 395148 2393796 4 04:20:02 PM 4717796 6997160 3164640 40.15 2688 2448492 730840 8.18 395148 2394216 4 04:21:01 PM 4717572 6997356 3164864 40.15 2688 2448912 730840 8.18 395152 2394372 264 04:22:01 PM 4716996 6997176 3165440 40.16 2688 2449308 747000 8.36 395152 2394704 252 04:23:01 PM 4715932 6996500 3166504 40.17 2688 2449704 783808 8.78 395152 2395372 260 04:24:01 PM 4713444 6994416 3168992 40.20 2688 2450092 799784 8.96 395152 2398136 244 04:25:01 PM 4709860 6991300 3172576 40.25 2688 2450556 849520 9.51 395152 2400956 336 04:26:01 PM 4709276 6991108 3173160 40.26 2688 2450948 849520 9.51 395152 2401424 356 04:27:01 PM 4708756 6990992 3173680 40.26 2688 2451344 890528 9.97 395152 2401920 4 04:28:01 PM 4764684 7050864 3117752 39.55 2688 2455292 639716 7.16 396044 2346432 3916 04:29:01 PM 4811496 6980384 3070940 38.96 2688 2343936 678560 7.60 614868 2104664 14236 Average: 4783039 6999070 3099397 39.32 2688 2385424 736615 8.25 364334 2361009 1554 12:09:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:10:01 PM eth0 251.33 151.13 1102.09 58.06 0.00 0.00 0.00 0.00 12:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:11:01 PM eth0 66.47 56.31 671.74 8.10 0.00 0.00 0.00 0.00 12:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:12:01 PM eth0 29.60 20.48 267.82 4.13 0.00 0.00 0.00 0.00 12:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:13:01 PM eth0 29.19 15.29 12.47 4.57 0.00 0.00 0.00 0.00 12:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:14:01 PM eth0 609.77 467.57 407.42 101.23 0.00 0.00 0.00 0.00 12:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:15:01 PM eth0 41.54 25.16 14.40 4.09 0.00 0.00 0.00 0.00 12:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:16:01 PM eth0 11.45 11.28 2.55 2.24 0.00 0.00 0.00 0.00 12:17:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:17:01 PM eth0 11.16 9.78 2.18 1.82 0.00 0.00 0.00 0.00 12:18:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:18:01 PM eth0 9.73 9.80 2.04 1.82 0.00 0.00 0.00 0.00 12:19:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:19:01 PM eth0 9.66 9.75 2.03 1.81 0.00 0.00 0.00 0.00 12:20:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:01 PM eth0 10.08 9.97 3.05 1.89 0.00 0.00 0.00 0.00 12:21:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 PM eth0 9.53 9.55 2.00 1.79 0.00 0.00 0.00 0.00 12:22:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:22:01 PM eth0 13.93 13.43 3.12 2.45 0.00 0.00 0.00 0.00 12:23:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:23:01 PM eth0 0.68 0.12 0.07 0.01 0.00 0.00 0.00 0.00 12:24:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:24:01 PM eth0 0.63 0.27 0.27 0.20 0.00 0.00 0.00 0.00 12:25:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 PM eth0 0.70 0.52 0.17 0.12 0.00 0.00 0.00 0.00 12:26:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 PM eth0 0.17 0.02 0.01 0.00 0.00 0.00 0.00 0.00 12:27:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 PM eth0 1.33 0.38 0.18 0.05 0.00 0.00 0.00 0.00 12:28:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 PM eth0 0.23 0.08 0.01 0.01 0.00 0.00 0.00 0.00 12:29:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 PM eth0 7.63 7.58 1.52 0.93 0.00 0.00 0.00 0.00 12:30:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:01 PM eth0 3.00 2.90 0.66 0.34 0.00 0.00 0.00 0.00 12:31:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 PM eth0 0.50 0.35 0.04 0.04 0.00 0.00 0.00 0.00 12:32:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 PM eth0 1.10 0.30 0.17 0.08 0.00 0.00 0.00 0.00 12:33:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 PM eth0 3.55 3.33 0.83 0.48 0.00 0.00 0.00 0.00 12:34:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 PM eth0 0.17 0.08 0.01 0.00 0.00 0.00 0.00 0.00 12:35:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 PM eth0 0.38 0.12 0.09 0.07 0.00 0.00 0.00 0.00 12:36:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:01 PM eth0 5.96 5.83 1.12 0.47 0.00 0.00 0.00 0.00 12:37:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 PM eth0 3.98 3.87 0.67 0.36 0.00 0.00 0.00 0.00 12:38:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 PM eth0 8.63 8.58 1.49 0.64 0.00 0.00 0.00 0.00 12:39:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:01 PM eth0 0.67 0.55 0.07 0.09 0.00 0.00 0.00 0.00 12:40:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 PM eth0 0.23 0.13 0.08 0.07 0.00 0.00 0.00 0.00 12:41:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 PM eth0 4.02 3.88 0.63 0.31 0.00 0.00 0.00 0.00 12:42:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 PM eth0 0.32 0.25 0.02 0.03 0.00 0.00 0.00 0.00 12:43:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 PM eth0 0.37 0.05 0.02 0.00 0.00 0.00 0.00 0.00 12:44:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 PM eth0 9.68 8.87 1.56 0.92 0.00 0.00 0.00 0.00 12:45:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 PM eth0 10.28 10.33 2.21 1.96 0.00 0.00 0.00 0.00 12:46:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:01 PM eth0 10.41 9.65 2.08 1.80 0.00 0.00 0.00 0.00 12:47:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 PM eth0 11.55 9.53 2.34 1.93 0.00 0.00 0.00 0.00 12:48:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 PM eth0 9.53 9.60 2.05 1.80 0.00 0.00 0.00 0.00 12:49:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 PM eth0 9.52 9.80 2.03 1.82 0.00 0.00 0.00 0.00 12:50:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:02 PM eth0 9.56 9.80 2.10 1.87 0.00 0.00 0.00 0.00 12:51:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 PM eth0 14.69 14.69 3.34 2.70 0.00 0.00 0.00 0.00 12:52:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 PM eth0 0.37 0.32 0.07 0.05 0.00 0.00 0.00 0.00 12:53:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 PM eth0 0.13 0.03 0.01 0.00 0.00 0.00 0.00 0.00 12:54:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 PM eth0 0.43 0.38 0.07 0.05 0.00 0.00 0.00 0.00 12:55:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 PM eth0 0.28 0.13 0.08 0.07 0.00 0.00 0.00 0.00 12:56:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 PM eth0 0.37 0.32 0.07 0.04 0.00 0.00 0.00 0.00 12:57:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 PM eth0 0.10 0.00 0.01 0.00 0.00 0.00 0.00 0.00 12:58:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 PM eth0 8.25 8.23 1.59 0.97 0.00 0.00 0.00 0.00 12:59:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 PM eth0 3.45 3.45 0.61 0.28 0.00 0.00 0.00 0.00 01:00:00 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:00 PM eth0 122.70 104.84 1405.39 7.23 0.00 0.00 0.00 0.00 01:00:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 PM eth0 10.45 10.45 1.22 2.19 0.00 0.00 0.00 0.00 01:01:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 PM eth0 1.25 0.38 0.42 0.27 0.00 0.00 0.00 0.00 01:02:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 PM eth0 0.45 0.18 0.26 0.19 0.00 0.00 0.00 0.00 01:03:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 PM eth0 3.78 3.67 0.88 0.31 0.00 0.00 0.00 0.00 01:04:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 PM eth0 0.07 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 PM eth0 4.63 4.18 0.83 0.41 0.00 0.00 0.00 0.00 01:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 PM eth0 0.68 0.65 0.08 0.10 0.00 0.00 0.00 0.00 01:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 PM eth0 0.08 0.02 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 PM eth0 2.85 2.85 0.54 0.21 0.00 0.00 0.00 0.00 01:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 PM eth0 4.12 4.12 0.70 0.38 0.00 0.00 0.00 0.00 01:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 PM eth0 0.27 0.15 0.08 0.07 0.00 0.00 0.00 0.00 01:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 PM eth0 0.17 0.07 0.01 0.00 0.00 0.00 0.00 0.00 01:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:01 PM eth0 9.80 10.00 1.87 1.02 0.00 0.00 0.00 0.00 01:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 PM eth0 6.46 6.01 1.38 1.16 0.00 0.00 0.00 0.00 01:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 PM eth0 9.78 9.93 2.27 2.00 0.00 0.00 0.00 0.00 01:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 PM eth0 9.33 9.48 2.02 1.81 0.00 0.00 0.00 0.00 01:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 PM eth0 9.35 9.66 2.02 1.81 0.00 0.00 0.00 0.00 01:17:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 PM eth0 9.32 9.68 2.01 1.81 0.00 0.00 0.00 0.00 01:18:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 PM eth0 9.90 9.65 2.15 1.86 0.00 0.00 0.00 0.00 01:19:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 PM eth0 18.83 18.80 4.40 3.62 0.00 0.00 0.00 0.00 01:20:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 PM eth0 1.40 0.77 0.54 0.21 0.00 0.00 0.00 0.00 01:21:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 PM eth0 0.38 0.17 0.26 0.19 0.00 0.00 0.00 0.00 01:22:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 PM eth0 0.38 0.30 0.07 0.04 0.00 0.00 0.00 0.00 01:23:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 PM eth0 0.68 0.00 0.07 0.00 0.00 0.00 0.00 0.00 01:24:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 PM eth0 1.23 0.45 0.57 0.39 0.00 0.00 0.00 0.00 01:25:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 PM eth0 0.47 0.37 0.14 0.10 0.00 0.00 0.00 0.00 01:26:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:01 PM eth0 0.53 0.00 0.06 0.00 0.00 0.00 0.00 0.00 01:27:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 PM eth0 8.30 8.15 1.84 1.19 0.00 0.00 0.00 0.00 01:28:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 PM eth0 3.13 3.05 0.58 0.28 0.00 0.00 0.00 0.00 01:29:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 PM eth0 0.85 0.05 0.10 0.00 0.00 0.00 0.00 0.00 01:30:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 PM eth0 2.38 2.15 0.66 0.22 0.00 0.00 0.00 0.00 01:31:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:01 PM eth0 0.65 0.50 0.08 0.10 0.00 0.00 0.00 0.00 01:32:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 PM eth0 0.83 0.13 0.16 0.07 0.00 0.00 0.00 0.00 01:33:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 PM eth0 2.57 2.30 0.73 0.35 0.00 0.00 0.00 0.00 01:34:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 PM eth0 5.78 5.82 1.19 0.56 0.00 0.00 0.00 0.00 01:35:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 PM eth0 4.75 4.35 0.79 0.41 0.00 0.00 0.00 0.00 01:36:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 PM eth0 3.77 3.80 0.67 0.39 0.00 0.00 0.00 0.00 01:37:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 PM eth0 0.62 0.03 0.06 0.00 0.00 0.00 0.00 0.00 01:38:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 PM eth0 0.55 0.32 0.27 0.20 0.00 0.00 0.00 0.00 01:39:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 PM eth0 2.98 2.98 0.57 0.29 0.00 0.00 0.00 0.00 01:40:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 PM eth0 0.27 0.10 0.08 0.06 0.00 0.00 0.00 0.00 01:41:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 PM eth0 2.32 2.33 0.49 0.45 0.00 0.00 0.00 0.00 01:42:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 PM eth0 11.23 10.88 2.00 1.34 0.00 0.00 0.00 0.00 01:43:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 PM eth0 9.77 9.70 2.28 1.99 0.00 0.00 0.00 0.00 01:44:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:01 PM eth0 9.61 9.83 2.16 1.82 0.00 0.00 0.00 0.00 01:45:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 PM eth0 9.60 9.82 2.10 1.88 0.00 0.00 0.00 0.00 01:46:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 PM eth0 9.48 9.77 2.02 1.81 0.00 0.00 0.00 0.00 01:47:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:01 PM eth0 10.43 10.05 2.57 2.19 0.00 0.00 0.00 0.00 01:48:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:01 PM eth0 12.76 13.00 2.90 2.47 0.00 0.00 0.00 0.00 01:49:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 PM eth0 7.63 7.18 1.67 1.24 0.00 0.00 0.00 0.00 01:50:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 PM eth0 0.32 0.10 0.08 0.06 0.00 0.00 0.00 0.00 01:51:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 PM eth0 0.35 0.32 0.07 0.05 0.00 0.00 0.00 0.00 01:52:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 PM eth0 0.20 0.07 0.01 0.00 0.00 0.00 0.00 0.00 01:53:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 PM eth0 0.12 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:54:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 PM eth0 0.47 0.35 0.07 0.05 0.00 0.00 0.00 0.00 01:55:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 PM eth0 0.23 0.13 0.08 0.07 0.00 0.00 0.00 0.00 01:56:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 PM eth0 8.06 8.23 1.58 0.97 0.00 0.00 0.00 0.00 01:57:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 PM eth0 6.82 6.05 1.59 0.77 0.00 0.00 0.00 0.00 01:58:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 PM eth0 0.62 0.52 0.08 0.11 0.00 0.00 0.00 0.00 01:59:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 PM eth0 0.18 0.10 0.01 0.01 0.00 0.00 0.00 0.00 02:00:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 PM eth0 3.02 2.90 0.61 0.27 0.00 0.00 0.00 0.00 02:01:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:02 PM eth0 0.47 0.42 0.06 0.08 0.00 0.00 0.00 0.00 02:02:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 PM eth0 0.12 0.05 0.01 0.00 0.00 0.00 0.00 0.00 02:03:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 PM eth0 3.83 3.72 0.66 0.31 0.00 0.00 0.00 0.00 02:04:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 PM eth0 0.37 0.35 0.03 0.05 0.00 0.00 0.00 0.00 02:05:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 PM eth0 0.27 0.12 0.08 0.06 0.00 0.00 0.00 0.00 02:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 PM eth0 8.32 8.30 1.32 0.63 0.00 0.00 0.00 0.00 02:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 PM eth0 0.62 0.53 0.07 0.11 0.00 0.00 0.00 0.00 02:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 PM eth0 0.10 0.05 0.01 0.00 0.00 0.00 0.00 0.00 02:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 PM eth0 4.50 3.97 0.73 0.28 0.00 0.00 0.00 0.00 02:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 PM eth0 6.88 6.93 1.38 0.86 0.00 0.00 0.00 0.00 02:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 PM eth0 9.33 9.68 1.99 1.81 0.00 0.00 0.00 0.00 02:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 PM eth0 9.40 9.63 2.02 1.81 0.00 0.00 0.00 0.00 02:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 PM eth0 9.31 9.61 2.01 1.80 0.00 0.00 0.00 0.00 02:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 PM eth0 9.43 9.75 2.02 1.81 0.00 0.00 0.00 0.00 02:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 PM eth0 9.53 9.71 2.09 1.87 0.00 0.00 0.00 0.00 02:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 PM eth0 9.33 9.58 2.01 1.80 0.00 0.00 0.00 0.00 02:17:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 PM eth0 15.03 15.03 3.44 2.78 0.00 0.00 0.00 0.00 02:18:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 PM eth0 1.07 0.42 0.22 0.11 0.00 0.00 0.00 0.00 02:19:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 PM eth0 0.55 0.22 0.59 0.19 0.00 0.00 0.00 0.00 02:20:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 PM eth0 0.63 0.47 0.15 0.11 0.00 0.00 0.00 0.00 02:21:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 PM eth0 0.08 0.05 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 PM eth0 0.37 0.32 0.07 0.04 0.00 0.00 0.00 0.00 02:23:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 PM eth0 0.03 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 PM eth0 3.50 3.57 0.78 0.66 0.00 0.00 0.00 0.00 02:25:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 PM eth0 7.77 7.78 1.45 0.63 0.00 0.00 0.00 0.00 02:26:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 PM eth0 0.57 0.55 0.08 0.10 0.00 0.00 0.00 0.00 02:27:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 PM eth0 0.23 0.10 0.01 0.00 0.00 0.00 0.00 0.00 02:28:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 PM eth0 3.27 3.25 0.62 0.28 0.00 0.00 0.00 0.00 02:29:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 PM eth0 6.17 6.18 1.10 0.49 0.00 0.00 0.00 0.00 02:30:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 PM eth0 4.30 4.23 0.76 0.44 0.00 0.00 0.00 0.00 02:31:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 PM eth0 4.53 4.53 0.68 0.37 0.00 0.00 0.00 0.00 02:32:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 PM eth0 0.83 0.12 0.16 0.07 0.00 0.00 0.00 0.00 02:33:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 PM eth0 2.72 2.50 0.74 0.64 0.00 0.00 0.00 0.00 02:34:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 PM eth0 9.03 9.25 1.58 1.03 0.00 0.00 0.00 0.00 02:35:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 PM eth0 10.13 10.15 2.23 1.94 0.00 0.00 0.00 0.00 02:36:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 PM eth0 9.23 9.63 2.01 1.80 0.00 0.00 0.00 0.00 02:37:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 PM eth0 9.12 9.38 1.94 1.74 0.00 0.00 0.00 0.00 02:38:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 PM eth0 9.40 9.68 2.02 1.81 0.00 0.00 0.00 0.00 02:39:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 PM eth0 9.25 9.46 2.01 1.79 0.00 0.00 0.00 0.00 02:40:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 PM eth0 9.63 9.83 2.31 1.88 0.00 0.00 0.00 0.00 02:41:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 PM eth0 11.78 11.50 2.71 2.11 0.00 0.00 0.00 0.00 02:42:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 PM eth0 0.15 0.05 0.01 0.00 0.00 0.00 0.00 0.00 02:43:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 PM eth0 0.13 0.05 0.01 0.00 0.00 0.00 0.00 0.00 02:44:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 PM eth0 0.25 0.28 0.06 0.04 0.00 0.00 0.00 0.00 02:45:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 PM eth0 0.23 0.10 0.08 0.06 0.00 0.00 0.00 0.00 02:46:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 PM eth0 0.40 0.38 0.08 0.05 0.00 0.00 0.00 0.00 02:47:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 PM eth0 0.37 0.17 0.26 0.19 0.00 0.00 0.00 0.00 02:48:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 PM eth0 6.67 6.75 1.46 0.88 0.00 0.00 0.00 0.00 02:49:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 PM eth0 3.00 2.98 0.62 0.31 0.00 0.00 0.00 0.00 02:50:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 PM eth0 0.37 0.25 0.10 0.10 0.00 0.00 0.00 0.00 02:51:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 PM eth0 0.82 0.27 0.16 0.08 0.00 0.00 0.00 0.00 02:52:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 PM eth0 4.65 4.48 1.24 0.57 0.00 0.00 0.00 0.00 02:53:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:01 PM eth0 3.82 3.82 0.64 0.35 0.00 0.00 0.00 0.00 02:54:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 PM eth0 8.27 8.22 1.24 0.62 0.00 0.00 0.00 0.00 02:55:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:01 PM eth0 0.80 0.70 0.15 0.16 0.00 0.00 0.00 0.00 02:56:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 PM eth0 0.07 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 PM eth0 7.48 7.63 1.33 0.80 0.00 0.00 0.00 0.00 02:58:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 PM eth0 7.55 7.87 1.60 1.45 0.00 0.00 0.00 0.00 02:59:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:01 PM eth0 9.46 9.63 2.02 1.80 0.00 0.00 0.00 0.00 03:00:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 PM eth0 9.37 9.58 2.08 1.86 0.00 0.00 0.00 0.00 03:01:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 PM eth0 9.30 9.63 2.01 1.81 0.00 0.00 0.00 0.00 03:02:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 PM eth0 9.25 9.66 2.01 1.80 0.00 0.00 0.00 0.00 03:03:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 PM eth0 9.12 9.40 1.94 1.75 0.00 0.00 0.00 0.00 03:04:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 PM eth0 16.51 16.53 3.75 3.06 0.00 0.00 0.00 0.00 03:05:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 PM eth0 0.53 0.42 0.16 0.11 0.00 0.00 0.00 0.00 03:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 PM eth0 0.10 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 PM eth0 0.33 0.32 0.07 0.04 0.00 0.00 0.00 0.00 03:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 PM eth0 0.05 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 PM eth0 0.32 0.28 0.07 0.04 0.00 0.00 0.00 0.00 03:10:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:02 PM eth0 0.23 0.10 0.08 0.06 0.00 0.00 0.00 0.00 03:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 PM eth0 3.20 3.24 0.74 0.60 0.00 0.00 0.00 0.00 03:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 PM eth0 6.63 6.67 1.27 0.53 0.00 0.00 0.00 0.00 03:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 PM eth0 0.53 0.55 0.07 0.09 0.00 0.00 0.00 0.00 03:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 PM eth0 0.12 0.10 0.01 0.00 0.00 0.00 0.00 0.00 03:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 PM eth0 2.17 2.12 0.49 0.26 0.00 0.00 0.00 0.00 03:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 PM eth0 0.33 0.27 0.05 0.06 0.00 0.00 0.00 0.00 03:17:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 PM eth0 2.65 2.65 0.58 0.25 0.00 0.00 0.00 0.00 03:18:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:18:01 PM eth0 0.05 0.02 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 PM eth0 0.05 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 PM eth0 7.13 7.31 1.63 1.07 0.00 0.00 0.00 0.00 03:21:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:21:01 PM eth0 9.76 10.05 2.05 1.83 0.00 0.00 0.00 0.00 03:22:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:22:01 PM eth0 9.32 9.63 2.01 1.81 0.00 0.00 0.00 0.00 03:23:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:23:01 PM eth0 9.28 9.57 2.01 1.80 0.00 0.00 0.00 0.00 03:24:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:24:01 PM eth0 9.30 9.65 2.01 1.81 0.00 0.00 0.00 0.00 03:25:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:25:01 PM eth0 9.53 9.68 2.09 1.86 0.00 0.00 0.00 0.00 03:26:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:26:01 PM eth0 9.27 9.63 2.01 1.81 0.00 0.00 0.00 0.00 03:27:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:27:01 PM eth0 13.28 13.18 3.04 2.41 0.00 0.00 0.00 0.00 03:28:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:28:01 PM eth0 0.08 0.02 0.00 0.00 0.00 0.00 0.00 0.00 03:29:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:29:01 PM eth0 0.15 0.05 0.01 0.00 0.00 0.00 0.00 0.00 03:30:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:30:01 PM eth0 0.58 0.48 0.16 0.11 0.00 0.00 0.00 0.00 03:31:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:31:01 PM eth0 0.03 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:32:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:32:01 PM eth0 1.07 0.47 0.22 0.12 0.00 0.00 0.00 0.00 03:33:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:33:01 PM eth0 0.60 0.30 0.85 0.20 0.00 0.00 0.00 0.00 03:34:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:34:01 PM eth0 6.72 6.78 1.45 0.87 0.00 0.00 0.00 0.00 03:35:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:35:01 PM eth0 7.13 7.32 1.67 1.04 0.00 0.00 0.00 0.00 03:36:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:36:01 PM eth0 6.40 6.68 1.35 1.23 0.00 0.00 0.00 0.00 03:37:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:37:01 PM eth0 9.40 9.65 2.02 1.81 0.00 0.00 0.00 0.00 03:38:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:38:01 PM eth0 9.35 9.66 2.02 1.81 0.00 0.00 0.00 0.00 03:39:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:39:01 PM eth0 9.30 9.67 2.01 1.81 0.00 0.00 0.00 0.00 03:40:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:40:01 PM eth0 9.40 9.60 2.07 1.85 0.00 0.00 0.00 0.00 03:41:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:41:01 PM eth0 9.17 9.57 1.98 1.78 0.00 0.00 0.00 0.00 03:42:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:42:01 PM eth0 17.59 17.61 3.95 3.25 0.00 0.00 0.00 0.00 03:43:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:43:01 PM eth0 0.48 0.40 0.10 0.06 0.00 0.00 0.00 0.00 03:44:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:44:01 PM eth0 0.02 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:45:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:45:01 PM eth0 0.58 0.48 0.15 0.11 0.00 0.00 0.00 0.00 03:46:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:01 PM eth0 0.13 0.05 0.01 0.00 0.00 0.00 0.00 0.00 03:47:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:47:01 PM eth0 0.63 0.42 0.32 0.23 0.00 0.00 0.00 0.00 03:48:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:48:01 PM eth0 0.08 0.03 0.00 0.00 0.00 0.00 0.00 0.00 03:49:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:49:01 PM eth0 0.03 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:50:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:50:01 PM eth0 8.38 8.57 1.91 1.22 0.00 0.00 0.00 0.00 03:51:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:51:01 PM eth0 6.28 6.15 1.30 0.79 0.00 0.00 0.00 0.00 03:52:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:52:01 PM eth0 11.61 11.53 2.51 2.18 0.00 0.00 0.00 0.00 03:53:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:53:01 PM eth0 9.38 9.55 2.22 1.95 0.00 0.00 0.00 0.00 03:54:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:54:01 PM eth0 9.32 9.42 1.99 1.77 0.00 0.00 0.00 0.00 03:55:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:55:01 PM eth0 9.40 9.73 2.09 1.87 0.00 0.00 0.00 0.00 03:56:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:56:01 PM eth0 9.36 9.63 2.02 1.81 0.00 0.00 0.00 0.00 03:57:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:57:01 PM eth0 10.30 9.70 2.42 2.05 0.00 0.00 0.00 0.00 03:58:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:58:01 PM eth0 12.65 12.68 2.93 2.33 0.00 0.00 0.00 0.00 03:59:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:59:01 PM eth0 0.08 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:00:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:00:01 PM eth0 0.25 0.13 0.08 0.07 0.00 0.00 0.00 0.00 04:01:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:01:01 PM eth0 0.32 0.32 0.06 0.04 0.00 0.00 0.00 0.00 04:02:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:02:01 PM eth0 0.62 0.00 0.07 0.00 0.00 0.00 0.00 0.00 04:03:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:03:01 PM eth0 0.97 0.53 0.66 0.24 0.00 0.00 0.00 0.00 04:04:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:04:01 PM eth0 0.10 0.05 0.00 0.00 0.00 0.00 0.00 0.00 04:05:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:05:01 PM eth0 7.23 7.15 1.56 0.96 0.00 0.00 0.00 0.00 04:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:06:01 PM eth0 7.27 6.87 1.72 0.99 0.00 0.00 0.00 0.00 04:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:07:01 PM eth0 7.22 7.43 1.52 1.38 0.00 0.00 0.00 0.00 04:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:08:01 PM eth0 9.40 9.65 2.02 1.81 0.00 0.00 0.00 0.00 04:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:09:01 PM eth0 9.15 9.50 2.00 1.79 0.00 0.00 0.00 0.00 04:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:10:01 PM eth0 9.30 9.55 2.04 1.81 0.00 0.00 0.00 0.00 04:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:11:01 PM eth0 9.23 9.52 1.99 1.80 0.00 0.00 0.00 0.00 04:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:12:01 PM eth0 9.35 9.68 2.01 1.81 0.00 0.00 0.00 0.00 04:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:13:01 PM eth0 17.30 17.26 3.90 3.20 0.00 0.00 0.00 0.00 04:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:14:01 PM eth0 0.45 0.38 0.10 0.06 0.00 0.00 0.00 0.00 04:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:15:01 PM eth0 1.00 0.20 0.24 0.13 0.00 0.00 0.00 0.00 04:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:16:01 PM eth0 3.05 2.58 1.82 0.61 0.00 0.00 0.00 0.00 04:17:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:17:01 PM eth0 0.08 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:18:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:18:01 PM eth0 0.25 0.25 0.06 0.04 0.00 0.00 0.00 0.00 04:19:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:19:01 PM eth0 0.12 0.05 0.01 0.00 0.00 0.00 0.00 0.00 04:20:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:20:02 PM eth0 0.27 0.12 0.08 0.07 0.00 0.00 0.00 0.00 04:21:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:21:01 PM eth0 9.08 9.22 3.17 1.11 0.00 0.00 0.00 0.00 04:22:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:22:01 PM eth0 6.86 6.93 2.84 0.93 0.00 0.00 0.00 0.00 04:23:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:23:01 PM eth0 7.75 7.37 3.22 1.07 0.00 0.00 0.00 0.00 04:24:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:24:01 PM eth0 8.12 8.27 2.80 0.85 0.00 0.00 0.00 0.00 04:25:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:25:01 PM eth0 8.86 8.90 2.81 1.80 0.00 0.00 0.00 0.00 04:26:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:26:01 PM eth0 8.12 8.08 2.91 0.96 0.00 0.00 0.00 0.00 04:27:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:27:01 PM eth0 7.03 6.98 2.91 0.97 0.00 0.00 0.00 0.00 04:28:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:28:01 PM eth0 8.45 9.00 2.84 1.00 0.00 0.00 0.00 0.00 04:29:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:29:01 PM eth0 105.15 71.88 197.63 222.96 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 9.48 8.09 16.68 2.35 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-547.el8.x86_64 (centos-stream-8-robot-8eca76b2-cb40-4fba-ac9e-845c8a03a7a7.noval) 04/14/2024 _x86_64_ (2 CPU) 12:08:39 LINUX RESTART (2 CPU) 12:09:01 PM CPU %user %nice %system %iowait %steal %idle 12:10:01 PM all 31.13 0.09 8.97 20.94 0.10 38.77 12:10:01 PM 0 27.24 0.08 7.96 20.67 0.10 43.95 12:10:01 PM 1 35.03 0.10 9.98 21.21 0.10 33.58 12:11:01 PM all 39.92 0.00 6.03 3.02 0.10 50.94 12:11:01 PM 0 33.43 0.00 5.28 2.39 0.10 58.79 12:11:01 PM 1 46.41 0.00 6.78 3.65 0.10 43.07 12:12:01 PM all 15.58 0.00 1.73 1.18 0.07 81.45 12:12:01 PM 0 4.52 0.00 1.40 1.13 0.07 92.88 12:12:01 PM 1 26.64 0.00 2.05 1.22 0.07 70.02 12:13:01 PM all 17.69 0.00 2.26 0.58 0.07 79.41 12:13:01 PM 0 16.39 0.00 1.94 0.58 0.07 81.02 12:13:01 PM 1 18.99 0.00 2.58 0.57 0.07 77.79 12:14:01 PM all 26.40 0.00 4.47 2.17 0.10 66.86 12:14:01 PM 0 28.37 0.00 4.64 1.96 0.10 64.92 12:14:01 PM 1 24.44 0.00 4.29 2.39 0.10 68.79 12:15:01 PM all 2.27 0.00 0.33 0.04 0.03 97.33 12:15:01 PM 0 3.65 0.00 0.30 0.05 0.03 95.96 12:15:01 PM 1 0.89 0.00 0.35 0.03 0.03 98.70 12:16:01 PM all 4.88 0.00 0.35 0.02 0.06 94.69 12:16:01 PM 0 4.52 0.00 0.30 0.02 0.05 95.11 12:16:01 PM 1 5.24 0.00 0.40 0.02 0.07 94.28 12:17:01 PM all 4.30 0.00 0.30 0.00 0.07 95.33 12:17:01 PM 0 2.81 0.00 0.23 0.00 0.07 96.89 12:17:01 PM 1 5.79 0.00 0.37 0.00 0.07 93.77 12:18:01 PM all 4.25 0.00 0.31 0.00 0.07 95.38 12:18:01 PM 0 2.84 0.00 0.27 0.00 0.07 96.82 12:18:01 PM 1 5.66 0.00 0.35 0.00 0.07 93.92 12:19:01 PM all 4.32 0.00 0.29 0.00 0.07 95.32 12:19:01 PM 0 3.55 0.00 0.22 0.00 0.07 96.17 12:19:01 PM 1 5.10 0.00 0.37 0.00 0.07 94.46 12:20:01 PM all 4.30 0.00 0.30 0.00 0.07 95.33 12:20:01 PM 0 2.26 0.00 0.23 0.00 0.05 97.46 12:20:01 PM 1 6.34 0.00 0.37 0.00 0.08 93.21 12:20:01 PM CPU %user %nice %system %iowait %steal %idle 12:21:01 PM all 4.22 0.00 0.33 0.00 0.05 95.41 12:21:01 PM 0 2.99 0.00 0.32 0.00 0.05 96.64 12:21:01 PM 1 5.44 0.00 0.33 0.00 0.05 94.17 12:22:01 PM all 5.16 0.00 0.28 0.00 0.06 94.50 12:22:01 PM 0 3.58 0.00 0.20 0.00 0.05 96.17 12:22:01 PM 1 6.75 0.00 0.35 0.00 0.07 92.84 12:23:01 PM all 0.34 0.00 0.08 0.00 0.03 99.54 12:23:01 PM 0 0.05 0.00 0.07 0.00 0.02 99.87 12:23:01 PM 1 0.63 0.00 0.10 0.00 0.05 99.22 12:24:01 PM all 0.38 0.00 0.20 0.01 0.05 99.37 12:24:01 PM 0 0.32 0.00 0.15 0.02 0.07 99.45 12:24:01 PM 1 0.43 0.00 0.25 0.00 0.03 99.28 12:25:01 PM all 0.51 0.00 0.07 0.00 0.03 99.39 12:25:01 PM 0 0.40 0.00 0.07 0.00 0.02 99.52 12:25:01 PM 1 0.62 0.00 0.07 0.00 0.05 99.27 12:26:01 PM all 0.33 0.00 0.05 0.00 0.03 99.58 12:26:01 PM 0 0.15 0.00 0.10 0.00 0.05 99.70 12:26:01 PM 1 0.52 0.00 0.00 0.00 0.02 99.47 12:27:01 PM all 0.47 0.00 0.08 0.00 0.04 99.41 12:27:01 PM 0 0.18 0.00 0.12 0.00 0.07 99.63 12:27:01 PM 1 0.75 0.00 0.05 0.00 0.02 99.18 12:28:01 PM all 0.22 0.00 0.06 0.00 0.03 99.69 12:28:01 PM 0 0.15 0.00 0.05 0.00 0.03 99.77 12:28:01 PM 1 0.28 0.00 0.07 0.00 0.03 99.62 12:29:01 PM all 3.78 0.00 2.54 0.00 0.05 93.63 12:29:01 PM 0 3.14 0.00 0.37 0.00 0.05 96.44 12:29:01 PM 1 4.43 0.00 4.70 0.00 0.05 90.83 12:30:01 PM all 6.66 0.00 2.91 0.00 0.06 90.37 12:30:01 PM 0 0.45 0.00 0.15 0.00 0.05 99.35 12:30:01 PM 1 13.43 0.00 5.91 0.00 0.07 80.58 12:31:01 PM all 1.60 0.00 0.14 0.00 0.03 98.22 12:31:01 PM 0 0.62 0.00 0.12 0.00 0.05 99.22 12:31:01 PM 1 2.60 0.00 0.17 0.00 0.02 97.21 12:31:01 PM CPU %user %nice %system %iowait %steal %idle 12:32:01 PM all 0.35 0.00 0.08 0.00 0.03 99.54 12:32:01 PM 0 0.60 0.00 0.07 0.00 0.02 99.32 12:32:01 PM 1 0.10 0.00 0.08 0.00 0.05 99.77 12:33:01 PM all 5.31 0.00 1.37 0.01 0.06 93.25 12:33:01 PM 0 0.67 0.00 0.13 0.00 0.05 99.15 12:33:01 PM 1 10.24 0.00 2.68 0.02 0.07 87.00 12:34:01 PM all 0.36 0.00 0.06 0.00 0.03 99.56 12:34:01 PM 0 0.65 0.00 0.07 0.00 0.03 99.25 12:34:01 PM 1 0.07 0.00 0.05 0.00 0.02 99.87 12:35:01 PM all 0.33 0.00 0.07 0.00 0.03 99.57 12:35:01 PM 0 0.60 0.00 0.08 0.00 0.05 99.26 12:35:01 PM 1 0.07 0.00 0.05 0.00 0.02 99.87 12:36:01 PM all 6.85 0.00 1.68 0.00 0.06 91.42 12:36:01 PM 0 4.73 0.00 0.38 0.00 0.05 94.84 12:36:01 PM 1 9.04 0.00 3.02 0.00 0.07 87.87 12:37:01 PM all 6.95 0.00 2.85 0.00 0.05 90.15 12:37:01 PM 0 10.97 0.00 5.61 0.00 0.05 83.36 12:37:01 PM 1 3.16 0.00 0.25 0.00 0.05 96.53 12:38:01 PM all 6.97 0.00 1.54 0.00 0.06 91.44 12:38:01 PM 0 4.82 0.00 0.36 0.00 0.07 94.75 12:38:01 PM 1 9.19 0.00 2.75 0.00 0.05 88.01 12:39:01 PM all 3.09 0.00 1.12 0.00 0.04 95.75 12:39:01 PM 0 5.83 0.00 2.16 0.00 0.03 91.98 12:39:01 PM 1 0.47 0.00 0.12 0.00 0.05 99.37 12:40:01 PM all 0.33 0.00 0.07 0.00 0.03 99.57 12:40:01 PM 0 0.17 0.00 0.10 0.00 0.05 99.68 12:40:01 PM 1 0.48 0.00 0.03 0.00 0.02 99.47 12:41:01 PM all 3.21 0.00 1.34 0.00 0.05 95.40 12:41:01 PM 0 6.45 0.00 2.64 0.00 0.07 90.84 12:41:01 PM 1 0.15 0.00 0.10 0.00 0.03 99.72 12:42:01 PM all 1.88 0.00 0.14 0.00 0.04 97.93 12:42:01 PM 0 0.62 0.00 0.08 0.00 0.03 99.27 12:42:01 PM 1 3.16 0.00 0.20 0.00 0.05 96.59 12:42:01 PM CPU %user %nice %system %iowait %steal %idle 12:43:01 PM all 0.35 0.00 0.06 0.00 0.03 99.56 12:43:01 PM 0 0.53 0.00 0.03 0.00 0.03 99.40 12:43:01 PM 1 0.17 0.00 0.08 0.00 0.03 99.72 12:44:01 PM all 5.88 0.00 2.53 0.00 0.06 91.53 12:44:01 PM 0 10.35 0.00 5.02 0.00 0.05 84.58 12:44:01 PM 1 1.65 0.00 0.18 0.00 0.07 98.10 12:45:01 PM all 5.25 0.00 0.32 0.00 0.06 94.37 12:45:01 PM 0 4.62 0.00 0.27 0.00 0.07 95.04 12:45:01 PM 1 5.88 0.00 0.37 0.00 0.05 93.70 12:46:01 PM all 4.25 0.00 0.28 0.00 0.07 95.40 12:46:01 PM 0 2.12 0.00 0.17 0.00 0.07 97.64 12:46:01 PM 1 6.38 0.00 0.40 0.00 0.07 93.15 12:47:01 PM all 4.28 0.00 0.33 0.00 0.07 95.33 12:47:01 PM 0 3.38 0.00 0.27 0.00 0.05 96.30 12:47:01 PM 1 5.17 0.00 0.38 0.00 0.08 94.36 12:48:01 PM all 4.40 0.00 0.28 0.00 0.07 95.25 12:48:01 PM 0 2.44 0.00 0.18 0.00 0.07 97.31 12:48:01 PM 1 6.36 0.00 0.39 0.00 0.07 93.18 12:49:01 PM all 4.23 0.00 0.31 0.00 0.07 95.39 12:49:01 PM 0 1.37 0.00 0.18 0.00 0.05 98.39 12:49:01 PM 1 7.10 0.00 0.44 0.00 0.08 92.38 12:50:02 PM all 4.24 0.00 0.30 0.00 0.06 95.41 12:50:02 PM 0 2.17 0.00 0.17 0.00 0.05 97.61 12:50:02 PM 1 6.30 0.00 0.44 0.00 0.07 93.20 12:51:01 PM all 5.51 0.00 0.28 0.00 0.07 94.14 12:51:01 PM 0 2.95 0.00 0.22 0.00 0.07 96.77 12:51:01 PM 1 8.08 0.00 0.34 0.00 0.07 91.51 12:52:01 PM all 0.48 0.00 0.06 0.00 0.03 99.42 12:52:01 PM 0 0.12 0.00 0.07 0.00 0.05 99.77 12:52:01 PM 1 0.85 0.00 0.05 0.00 0.02 99.08 12:53:01 PM all 0.33 0.00 0.07 0.00 0.03 99.57 12:53:01 PM 0 0.10 0.00 0.08 0.00 0.03 99.78 12:53:01 PM 1 0.57 0.00 0.05 0.00 0.03 99.35 12:53:01 PM CPU %user %nice %system %iowait %steal %idle 12:54:01 PM all 0.51 0.00 0.05 0.00 0.03 99.42 12:54:01 PM 0 0.58 0.00 0.05 0.00 0.03 99.33 12:54:01 PM 1 0.43 0.00 0.05 0.00 0.02 99.50 12:55:01 PM all 0.32 0.00 0.06 0.00 0.04 99.58 12:55:01 PM 0 0.52 0.00 0.03 0.00 0.03 99.42 12:55:01 PM 1 0.12 0.00 0.08 0.00 0.05 99.75 12:56:01 PM all 0.47 0.00 0.07 0.00 0.03 99.44 12:56:01 PM 0 0.57 0.00 0.05 0.00 0.02 99.37 12:56:01 PM 1 0.37 0.00 0.08 0.00 0.03 99.52 12:57:01 PM all 0.31 0.00 0.05 0.00 0.03 99.61 12:57:01 PM 0 0.55 0.00 0.03 0.00 0.03 99.38 12:57:01 PM 1 0.07 0.00 0.07 0.00 0.03 99.83 12:58:01 PM all 2.97 0.00 0.91 0.00 0.04 96.07 12:58:01 PM 0 1.31 0.00 1.42 0.00 0.03 97.24 12:58:01 PM 1 4.66 0.00 0.39 0.00 0.05 94.90 12:59:01 PM all 6.09 0.00 2.79 0.00 0.07 91.05 12:59:01 PM 0 4.75 0.00 4.52 0.00 0.07 90.66 12:59:01 PM 1 7.41 0.00 1.09 0.00 0.07 91.44 01:00:00 PM all 6.73 13.58 3.04 0.71 0.07 75.87 01:00:00 PM 0 6.91 12.71 3.08 0.67 0.07 76.56 01:00:00 PM 1 6.55 14.45 3.00 0.74 0.07 75.19 01:00:01 PM all 33.58 47.01 10.45 0.00 0.00 8.96 01:00:01 PM 0 66.67 0.00 15.15 0.00 0.00 18.18 01:00:01 PM 1 1.47 92.65 5.88 0.00 0.00 0.00 01:01:01 PM all 0.35 3.09 0.23 0.87 0.04 95.43 01:01:01 PM 0 0.63 0.12 0.20 0.62 0.05 98.38 01:01:01 PM 1 0.07 6.06 0.25 1.12 0.03 92.48 01:02:01 PM all 0.36 0.00 0.08 0.01 0.03 99.52 01:02:01 PM 0 0.57 0.00 0.05 0.02 0.03 99.33 01:02:01 PM 1 0.15 0.00 0.10 0.00 0.03 99.72 01:03:01 PM all 4.64 0.00 1.44 0.00 0.06 93.86 01:03:01 PM 0 8.93 0.00 2.81 0.00 0.05 88.21 01:03:01 PM 1 0.62 0.00 0.15 0.00 0.07 99.17 01:03:01 PM CPU %user %nice %system %iowait %steal %idle 01:04:01 PM all 0.34 0.00 0.08 0.01 0.03 99.54 01:04:01 PM 0 0.10 0.00 0.07 0.00 0.03 99.80 01:04:01 PM 1 0.58 0.00 0.08 0.02 0.03 99.28 01:05:01 PM all 1.39 0.00 0.13 0.00 0.04 98.44 01:05:01 PM 0 2.20 0.00 0.20 0.00 0.05 97.55 01:05:01 PM 1 0.58 0.00 0.07 0.00 0.03 99.32 01:06:01 PM all 3.91 0.00 1.16 0.00 0.04 94.88 01:06:01 PM 0 7.39 0.00 2.30 0.00 0.04 90.27 01:06:01 PM 1 0.60 0.00 0.08 0.00 0.05 99.27 01:07:01 PM all 0.33 0.00 0.06 0.00 0.04 99.57 01:07:01 PM 0 0.08 0.00 0.05 0.00 0.05 99.82 01:07:01 PM 1 0.58 0.00 0.07 0.00 0.03 99.32 01:08:01 PM all 2.71 0.00 0.54 0.00 0.04 96.71 01:08:01 PM 0 5.19 0.00 1.01 0.00 0.05 93.76 01:08:01 PM 1 0.33 0.00 0.08 0.00 0.03 99.55 01:09:01 PM all 6.63 0.00 1.99 0.01 0.05 91.32 01:09:01 PM 0 13.30 0.00 4.05 0.02 0.07 82.56 01:09:01 PM 1 0.58 0.00 0.12 0.00 0.03 99.27 01:10:01 PM all 0.36 0.00 0.08 0.00 0.03 99.53 01:10:01 PM 0 0.13 0.00 0.10 0.00 0.03 99.73 01:10:01 PM 1 0.58 0.00 0.05 0.00 0.03 99.33 01:11:01 PM all 0.37 0.00 0.08 0.00 0.04 99.51 01:11:01 PM 0 0.18 0.00 0.12 0.00 0.05 99.65 01:11:01 PM 1 0.55 0.00 0.05 0.00 0.03 99.37 01:12:01 PM all 7.44 0.00 1.42 0.00 0.05 91.09 01:12:01 PM 0 11.71 0.00 2.60 0.00 0.07 85.63 01:12:01 PM 1 3.42 0.00 0.30 0.00 0.03 96.24 01:13:01 PM all 6.31 0.00 2.36 0.00 0.07 91.26 01:13:01 PM 0 10.04 0.00 4.65 0.00 0.07 85.24 01:13:01 PM 1 2.79 0.00 0.20 0.00 0.07 96.94 01:14:01 PM all 4.29 0.00 0.31 0.00 0.08 95.32 01:14:01 PM 0 4.59 0.00 0.33 0.00 0.08 95.00 01:14:01 PM 1 4.00 0.00 0.28 0.00 0.07 95.65 01:14:01 PM CPU %user %nice %system %iowait %steal %idle 01:15:01 PM all 4.13 0.00 0.28 0.00 0.06 95.52 01:15:01 PM 0 3.85 0.00 0.25 0.00 0.05 95.85 01:15:01 PM 1 4.41 0.00 0.32 0.00 0.07 95.20 01:16:01 PM all 4.31 0.00 0.30 0.00 0.06 95.33 01:16:01 PM 0 2.26 0.00 0.18 0.00 0.05 97.51 01:16:01 PM 1 6.36 0.00 0.42 0.00 0.07 93.15 01:17:01 PM all 4.27 0.00 0.33 0.00 0.07 95.33 01:17:01 PM 0 6.69 0.00 0.45 0.00 0.07 92.79 01:17:01 PM 1 1.87 0.00 0.20 0.00 0.07 97.86 01:18:01 PM all 4.27 0.00 0.28 0.00 0.07 95.38 01:18:01 PM 0 5.72 0.00 0.33 0.00 0.08 93.86 01:18:01 PM 1 2.82 0.00 0.23 0.00 0.05 96.89 01:19:01 PM all 7.14 0.00 0.39 0.00 0.08 92.39 01:19:01 PM 0 4.94 0.00 0.32 0.00 0.07 94.68 01:19:01 PM 1 9.35 0.00 0.47 0.00 0.08 90.09 01:20:01 PM all 0.63 0.00 0.09 0.01 0.05 99.22 01:20:01 PM 0 0.62 0.00 0.10 0.02 0.05 99.21 01:20:01 PM 1 0.65 0.00 0.08 0.00 0.05 99.22 01:21:01 PM all 0.35 0.00 0.05 0.00 0.03 99.57 01:21:01 PM 0 0.57 0.00 0.03 0.00 0.03 99.37 01:21:01 PM 1 0.13 0.00 0.07 0.00 0.02 99.78 01:22:01 PM all 0.42 0.00 0.10 0.00 0.04 99.44 01:22:01 PM 0 0.38 0.00 0.08 0.00 0.03 99.50 01:22:01 PM 1 0.45 0.00 0.12 0.00 0.05 99.38 01:23:01 PM all 0.13 0.00 0.07 0.00 0.03 99.77 01:23:01 PM 0 0.25 0.00 0.10 0.00 0.05 99.60 01:23:01 PM 1 0.02 0.00 0.03 0.00 0.00 99.95 01:24:01 PM all 0.38 0.00 0.06 0.03 0.04 99.49 01:24:01 PM 0 0.65 0.00 0.07 0.05 0.05 99.18 01:24:01 PM 1 0.12 0.00 0.05 0.00 0.03 99.80 01:25:01 PM all 0.48 0.00 0.06 0.00 0.03 99.42 01:25:01 PM 0 0.58 0.00 0.07 0.00 0.03 99.32 01:25:01 PM 1 0.38 0.00 0.05 0.00 0.03 99.53 01:25:01 PM CPU %user %nice %system %iowait %steal %idle 01:26:01 PM all 0.33 0.00 0.06 0.00 0.03 99.58 01:26:01 PM 0 0.55 0.00 0.07 0.00 0.03 99.35 01:26:01 PM 1 0.12 0.00 0.05 0.00 0.02 99.82 01:27:01 PM all 5.95 0.00 4.59 0.00 0.05 89.41 01:27:01 PM 0 7.43 0.00 8.84 0.00 0.05 83.68 01:27:01 PM 1 4.49 0.00 0.42 0.00 0.05 95.04 01:28:01 PM all 5.61 0.00 1.34 0.00 0.09 92.96 01:28:01 PM 0 1.43 0.00 0.15 0.00 0.07 98.35 01:28:01 PM 1 10.02 0.00 2.60 0.00 0.11 87.27 01:29:01 PM all 0.35 0.00 0.07 0.00 0.03 99.55 01:29:01 PM 0 0.57 0.00 0.05 0.00 0.03 99.35 01:29:01 PM 1 0.13 0.00 0.08 0.00 0.03 99.75 01:30:01 PM all 1.21 0.00 0.13 0.00 0.04 98.62 01:30:01 PM 0 0.62 0.00 0.10 0.00 0.03 99.25 01:30:01 PM 1 1.82 0.00 0.15 0.00 0.05 97.98 01:31:01 PM all 3.75 0.00 1.16 0.01 0.05 95.04 01:31:01 PM 0 0.65 0.00 0.13 0.02 0.07 99.13 01:31:01 PM 1 7.01 0.00 2.24 0.00 0.04 90.71 01:32:01 PM all 0.27 0.01 0.11 0.03 0.04 99.55 01:32:01 PM 0 0.47 0.02 0.15 0.05 0.05 99.26 01:32:01 PM 1 0.07 0.00 0.07 0.00 0.03 99.83 01:33:01 PM all 2.65 0.00 0.53 0.00 0.04 96.78 01:33:01 PM 0 0.68 0.00 0.13 0.00 0.03 99.15 01:33:01 PM 1 4.69 0.00 0.94 0.00 0.05 94.31 01:34:01 PM all 7.36 0.00 2.22 0.00 0.06 90.35 01:34:01 PM 0 9.88 0.00 2.82 0.00 0.07 87.23 01:34:01 PM 1 4.90 0.00 1.64 0.00 0.05 93.41 01:35:01 PM all 6.77 0.00 1.57 0.00 0.07 91.59 01:35:01 PM 0 0.62 0.00 0.20 0.00 0.07 99.11 01:35:01 PM 1 13.53 0.00 3.08 0.00 0.07 83.32 01:36:01 PM all 6.95 0.00 2.23 0.00 0.06 90.75 01:36:01 PM 0 0.57 0.00 0.22 0.00 0.05 99.16 01:36:01 PM 1 13.97 0.00 4.46 0.00 0.07 81.50 01:36:01 PM CPU %user %nice %system %iowait %steal %idle 01:37:01 PM all 0.28 0.00 0.10 0.00 0.05 99.57 01:37:01 PM 0 0.42 0.00 0.15 0.00 0.05 99.38 01:37:01 PM 1 0.13 0.00 0.05 0.00 0.05 99.77 01:38:01 PM all 0.19 0.00 0.08 0.00 0.04 99.68 01:38:01 PM 0 0.23 0.00 0.08 0.00 0.05 99.63 01:38:01 PM 1 0.15 0.00 0.08 0.00 0.03 99.73 01:39:01 PM all 5.19 0.00 1.27 0.00 0.05 93.49 01:39:01 PM 0 0.37 0.00 0.17 0.00 0.05 99.42 01:39:01 PM 1 10.30 0.00 2.44 0.00 0.05 87.20 01:40:01 PM all 0.35 0.00 0.07 0.00 0.03 99.55 01:40:01 PM 0 0.60 0.00 0.07 0.00 0.03 99.30 01:40:01 PM 1 0.10 0.00 0.07 0.00 0.03 99.80 01:41:01 PM all 1.89 0.00 0.13 0.00 0.06 97.93 01:41:01 PM 0 2.92 0.00 0.17 0.00 0.05 96.86 01:41:01 PM 1 0.87 0.00 0.08 0.00 0.07 98.98 01:42:01 PM all 6.51 0.00 2.61 0.00 0.05 90.83 01:42:01 PM 0 3.36 0.00 0.36 0.00 0.05 96.24 01:42:01 PM 1 9.75 0.00 4.91 0.00 0.05 85.28 01:43:01 PM all 4.19 0.00 0.29 0.00 0.07 95.45 01:43:01 PM 0 4.81 0.00 0.32 0.00 0.07 94.81 01:43:01 PM 1 3.56 0.00 0.27 0.00 0.07 96.10 01:44:01 PM all 4.28 0.00 0.33 0.00 0.07 95.32 01:44:01 PM 0 2.79 0.00 0.25 0.00 0.07 96.89 01:44:01 PM 1 5.77 0.00 0.42 0.00 0.07 93.74 01:45:01 PM all 4.29 0.00 0.32 0.00 0.06 95.33 01:45:01 PM 0 2.41 0.00 0.20 0.00 0.05 97.34 01:45:01 PM 1 6.18 0.00 0.44 0.00 0.07 93.32 01:46:01 PM all 4.27 0.00 0.31 0.00 0.07 95.36 01:46:01 PM 0 2.72 0.00 0.22 0.00 0.07 96.99 01:46:01 PM 1 5.81 0.00 0.40 0.00 0.07 93.72 01:47:01 PM all 4.30 0.00 0.28 0.00 0.07 95.35 01:47:01 PM 0 4.69 0.00 0.35 0.00 0.07 94.89 01:47:01 PM 1 3.91 0.00 0.22 0.00 0.07 95.80 01:47:01 PM CPU %user %nice %system %iowait %steal %idle 01:48:01 PM all 5.58 0.00 0.33 0.00 0.08 94.01 01:48:01 PM 0 6.60 0.00 0.37 0.00 0.07 92.97 01:48:01 PM 1 4.57 0.00 0.30 0.00 0.08 95.05 01:49:01 PM all 2.62 0.00 0.13 0.00 0.05 97.20 01:49:01 PM 0 0.65 0.00 0.12 0.00 0.07 99.16 01:49:01 PM 1 4.59 0.00 0.13 0.00 0.03 95.24 01:50:01 PM all 0.34 0.00 0.07 0.00 0.03 99.56 01:50:01 PM 0 0.12 0.00 0.08 0.00 0.03 99.77 01:50:01 PM 1 0.57 0.00 0.05 0.00 0.03 99.35 01:51:01 PM all 0.52 0.00 0.08 0.00 0.04 99.36 01:51:01 PM 0 0.48 0.00 0.12 0.00 0.05 99.35 01:51:01 PM 1 0.55 0.00 0.05 0.00 0.03 99.37 01:52:01 PM all 0.33 0.00 0.07 0.00 0.03 99.57 01:52:01 PM 0 0.05 0.00 0.05 0.00 0.02 99.88 01:52:01 PM 1 0.62 0.00 0.08 0.00 0.03 99.27 01:53:01 PM all 0.33 0.00 0.07 0.00 0.04 99.57 01:53:01 PM 0 0.12 0.00 0.10 0.00 0.05 99.73 01:53:01 PM 1 0.53 0.00 0.03 0.00 0.03 99.40 01:54:01 PM all 0.52 0.00 0.07 0.01 0.03 99.38 01:54:01 PM 0 0.45 0.00 0.08 0.00 0.03 99.43 01:54:01 PM 1 0.58 0.00 0.05 0.02 0.02 99.33 01:55:01 PM all 0.33 0.00 0.05 0.00 0.04 99.57 01:55:01 PM 0 0.12 0.00 0.07 0.00 0.05 99.77 01:55:01 PM 1 0.55 0.00 0.03 0.00 0.03 99.38 01:56:01 PM all 5.20 0.00 3.29 0.00 0.06 91.45 01:56:01 PM 0 5.78 0.00 6.26 0.00 0.07 87.89 01:56:01 PM 1 4.64 0.00 0.44 0.00 0.05 94.86 01:57:01 PM all 6.94 0.00 1.41 0.00 0.07 91.58 01:57:01 PM 0 13.46 0.00 2.73 0.00 0.09 83.72 01:57:01 PM 1 1.02 0.00 0.20 0.00 0.05 98.73 01:58:01 PM all 4.26 0.00 1.55 0.01 0.05 94.14 01:58:01 PM 0 8.06 0.00 3.05 0.02 0.05 88.82 01:58:01 PM 1 0.63 0.00 0.12 0.00 0.05 99.20 01:58:01 PM CPU %user %nice %system %iowait %steal %idle 01:59:01 PM all 0.35 0.00 0.08 0.00 0.03 99.54 01:59:01 PM 0 0.12 0.00 0.08 0.00 0.03 99.77 01:59:01 PM 1 0.58 0.00 0.07 0.00 0.03 99.32 02:00:01 PM all 2.72 0.00 0.27 0.00 0.05 96.96 02:00:01 PM 0 0.32 0.00 0.10 0.00 0.05 99.53 02:00:01 PM 1 5.19 0.00 0.45 0.00 0.05 94.32 02:01:02 PM all 2.34 0.00 0.98 0.00 0.03 96.64 02:01:02 PM 0 4.11 0.00 1.90 0.00 0.03 93.96 02:01:02 PM 1 0.63 0.00 0.10 0.00 0.03 99.23 02:02:01 PM all 0.34 0.00 0.06 0.00 0.04 99.56 02:02:01 PM 0 0.07 0.00 0.05 0.00 0.03 99.85 02:02:01 PM 1 0.61 0.00 0.07 0.00 0.05 99.27 02:03:01 PM all 4.05 0.00 1.30 0.00 0.05 94.60 02:03:01 PM 0 7.61 0.00 2.55 0.00 0.05 89.79 02:03:01 PM 1 0.68 0.00 0.12 0.00 0.05 99.15 02:04:01 PM all 1.33 0.00 0.13 0.00 0.03 98.51 02:04:01 PM 0 2.19 0.00 0.10 0.00 0.02 97.69 02:04:01 PM 1 0.48 0.00 0.15 0.00 0.05 99.31 02:05:01 PM all 0.33 0.00 0.07 0.00 0.04 99.56 02:05:01 PM 0 0.12 0.00 0.08 0.00 0.05 99.75 02:05:01 PM 1 0.55 0.00 0.05 0.00 0.03 99.37 02:06:01 PM all 5.33 0.00 1.41 0.00 0.05 93.20 02:06:01 PM 0 10.44 0.00 2.80 0.00 0.05 86.71 02:06:01 PM 1 0.62 0.00 0.13 0.00 0.05 99.20 02:07:01 PM all 4.26 0.00 1.60 0.00 0.05 94.08 02:07:01 PM 0 8.06 0.00 3.15 0.00 0.05 88.74 02:07:01 PM 1 0.62 0.00 0.12 0.00 0.05 99.22 02:08:01 PM all 0.19 0.00 0.08 0.00 0.04 99.68 02:08:01 PM 0 0.23 0.00 0.10 0.00 0.03 99.63 02:08:01 PM 1 0.15 0.00 0.07 0.00 0.05 99.73 02:09:01 PM all 2.48 0.00 0.45 0.00 0.04 97.03 02:09:01 PM 0 4.81 0.00 0.76 0.00 0.03 94.39 02:09:01 PM 1 0.23 0.00 0.15 0.00 0.05 99.57 02:09:01 PM CPU %user %nice %system %iowait %steal %idle 02:10:01 PM all 7.74 0.00 3.03 0.00 0.06 89.16 02:10:01 PM 0 6.14 0.00 2.01 0.00 0.05 91.80 02:10:01 PM 1 9.39 0.00 4.09 0.00 0.07 86.45 02:11:01 PM all 5.36 0.00 0.56 0.00 0.07 94.01 02:11:01 PM 0 2.24 0.00 0.22 0.00 0.07 97.48 02:11:01 PM 1 8.52 0.00 0.91 0.00 0.07 90.50 02:12:01 PM all 4.22 0.01 0.33 0.00 0.06 95.38 02:12:01 PM 0 2.34 0.02 0.18 0.00 0.05 97.41 02:12:01 PM 1 6.11 0.00 0.47 0.00 0.07 93.35 02:13:01 PM all 4.22 0.00 0.31 0.00 0.06 95.41 02:13:01 PM 0 2.79 0.00 0.23 0.00 0.05 96.92 02:13:01 PM 1 5.64 0.00 0.39 0.00 0.07 93.91 02:14:01 PM all 4.24 0.00 0.27 0.00 0.07 95.42 02:14:01 PM 0 4.66 0.00 0.32 0.00 0.08 94.94 02:14:01 PM 1 3.83 0.00 0.22 0.00 0.05 95.90 02:15:01 PM all 4.26 0.00 0.33 0.00 0.07 95.34 02:15:01 PM 0 3.96 0.00 0.33 0.00 0.07 95.63 02:15:01 PM 1 4.57 0.00 0.32 0.00 0.07 95.05 02:16:01 PM all 4.27 0.00 0.28 0.00 0.08 95.38 02:16:01 PM 0 1.62 0.00 0.13 0.00 0.07 98.18 02:16:01 PM 1 6.93 0.00 0.42 0.00 0.08 92.57 02:17:01 PM all 5.79 0.00 0.31 0.00 0.08 93.82 02:17:01 PM 0 4.65 0.00 0.35 0.00 0.08 94.91 02:17:01 PM 1 6.93 0.00 0.27 0.00 0.08 92.72 02:18:01 PM all 0.50 0.00 0.07 0.00 0.04 99.39 02:18:01 PM 0 0.60 0.00 0.07 0.00 0.05 99.28 02:18:01 PM 1 0.40 0.00 0.07 0.00 0.03 99.50 02:19:01 PM all 0.35 0.16 0.11 0.01 0.03 99.34 02:19:01 PM 0 0.53 0.28 0.10 0.00 0.02 99.07 02:19:01 PM 1 0.17 0.03 0.12 0.02 0.05 99.62 02:20:01 PM all 0.53 0.00 0.06 0.00 0.04 99.37 02:20:01 PM 0 0.57 0.00 0.07 0.00 0.03 99.33 02:20:01 PM 1 0.50 0.00 0.05 0.00 0.05 99.40 02:20:01 PM CPU %user %nice %system %iowait %steal %idle 02:21:01 PM all 0.34 0.00 0.06 0.00 0.04 99.56 02:21:01 PM 0 0.60 0.00 0.05 0.00 0.05 99.30 02:21:01 PM 1 0.08 0.00 0.07 0.00 0.03 99.82 02:22:01 PM all 0.50 0.00 0.06 0.00 0.03 99.41 02:22:01 PM 0 0.72 0.00 0.05 0.00 0.03 99.20 02:22:01 PM 1 0.28 0.00 0.07 0.00 0.03 99.62 02:23:01 PM all 0.33 0.00 0.06 0.00 0.03 99.57 02:23:01 PM 0 0.53 0.00 0.03 0.00 0.03 99.40 02:23:01 PM 1 0.13 0.00 0.08 0.00 0.03 99.75 02:24:01 PM all 2.51 0.00 0.18 0.00 0.05 97.25 02:24:01 PM 0 0.58 0.00 0.13 0.00 0.03 99.25 02:24:01 PM 1 4.47 0.00 0.24 0.00 0.07 95.23 02:25:01 PM all 5.88 0.00 4.12 0.00 0.07 89.93 02:25:01 PM 0 0.78 0.00 0.20 0.00 0.07 98.95 02:25:01 PM 1 11.49 0.00 8.43 0.00 0.07 80.01 02:26:01 PM all 2.78 0.00 1.15 0.00 0.03 96.04 02:26:01 PM 0 0.92 0.00 0.10 0.00 0.02 98.96 02:26:01 PM 1 4.71 0.00 2.23 0.00 0.05 93.01 02:27:01 PM all 0.32 0.00 0.09 0.00 0.03 99.56 02:27:01 PM 0 0.15 0.00 0.08 0.00 0.03 99.73 02:27:01 PM 1 0.48 0.00 0.10 0.00 0.03 99.38 02:28:01 PM all 4.01 0.00 1.48 0.00 0.05 94.46 02:28:01 PM 0 7.57 0.00 2.94 0.00 0.05 89.44 02:28:01 PM 1 0.58 0.00 0.08 0.00 0.05 99.28 02:29:01 PM all 6.81 0.00 1.39 0.00 0.07 91.73 02:29:01 PM 0 2.21 0.00 0.22 0.00 0.07 97.50 02:29:01 PM 1 11.70 0.00 2.64 0.00 0.07 85.58 02:30:01 PM all 6.67 0.00 2.58 0.00 0.06 90.68 02:30:01 PM 0 6.57 0.00 2.62 0.00 0.07 90.74 02:30:01 PM 1 6.77 0.00 2.54 0.00 0.05 90.63 02:31:01 PM all 6.43 0.00 1.52 0.00 0.06 91.99 02:31:01 PM 0 12.00 0.00 3.01 0.00 0.07 84.92 02:31:01 PM 1 1.23 0.00 0.13 0.00 0.05 98.58 02:31:01 PM CPU %user %nice %system %iowait %steal %idle 02:32:01 PM all 0.37 0.00 0.07 0.00 0.03 99.53 02:32:01 PM 0 0.62 0.00 0.05 0.00 0.03 99.30 02:32:01 PM 1 0.12 0.00 0.08 0.00 0.03 99.77 02:33:01 PM all 1.27 0.00 0.11 0.00 0.04 98.58 02:33:01 PM 0 1.09 0.00 0.12 0.00 0.05 98.74 02:33:01 PM 1 1.45 0.00 0.10 0.00 0.03 98.41 02:34:01 PM all 6.53 0.00 2.74 0.00 0.05 90.68 02:34:01 PM 0 6.26 0.00 0.48 0.00 0.05 93.21 02:34:01 PM 1 6.81 0.00 5.03 0.00 0.05 88.11 02:35:01 PM all 4.36 0.00 0.35 0.00 0.06 95.23 02:35:01 PM 0 3.53 0.00 0.27 0.00 0.05 96.15 02:35:01 PM 1 5.19 0.00 0.44 0.00 0.07 94.31 02:36:01 PM all 4.31 0.00 0.33 0.01 0.07 95.29 02:36:01 PM 0 2.09 0.00 0.23 0.02 0.07 97.59 02:36:01 PM 1 6.53 0.00 0.42 0.00 0.07 92.98 02:37:01 PM all 4.20 0.00 0.28 0.00 0.06 95.46 02:37:01 PM 0 4.07 0.00 0.28 0.00 0.05 95.60 02:37:01 PM 1 4.33 0.00 0.28 0.00 0.07 95.31 02:38:01 PM all 4.26 0.00 0.31 0.00 0.07 95.37 02:38:01 PM 0 1.57 0.00 0.18 0.00 0.07 98.18 02:38:01 PM 1 6.95 0.00 0.44 0.00 0.07 92.55 02:39:01 PM all 4.25 0.00 0.31 0.00 0.06 95.38 02:39:01 PM 0 2.01 0.00 0.18 0.00 0.05 97.76 02:39:01 PM 1 6.49 0.00 0.44 0.00 0.07 93.00 02:40:01 PM all 4.27 0.00 0.28 0.00 0.07 95.38 02:40:01 PM 0 1.02 0.00 0.13 0.00 0.05 98.80 02:40:01 PM 1 7.53 0.00 0.44 0.00 0.08 91.95 02:41:01 PM all 4.42 0.00 0.24 0.00 0.06 95.28 02:41:01 PM 0 2.69 0.00 0.22 0.00 0.05 97.04 02:41:01 PM 1 6.16 0.00 0.27 0.00 0.07 93.51 02:42:01 PM all 0.33 0.00 0.05 0.00 0.03 99.59 02:42:01 PM 0 0.17 0.00 0.08 0.00 0.05 99.70 02:42:01 PM 1 0.50 0.00 0.02 0.00 0.00 99.48 02:42:01 PM CPU %user %nice %system %iowait %steal %idle 02:43:01 PM all 0.39 0.00 0.05 0.00 0.04 99.52 02:43:01 PM 0 0.20 0.00 0.07 0.00 0.05 99.68 02:43:01 PM 1 0.58 0.00 0.03 0.00 0.03 99.35 02:44:01 PM all 0.48 0.00 0.06 0.00 0.03 99.42 02:44:01 PM 0 0.53 0.00 0.03 0.00 0.03 99.40 02:44:01 PM 1 0.43 0.00 0.08 0.00 0.03 99.45 02:45:01 PM all 0.33 0.00 0.07 0.00 0.03 99.57 02:45:01 PM 0 0.55 0.00 0.07 0.00 0.03 99.35 02:45:01 PM 1 0.12 0.00 0.07 0.00 0.03 99.78 02:46:01 PM all 0.50 0.00 0.06 0.00 0.05 99.39 02:46:01 PM 0 0.58 0.00 0.05 0.00 0.05 99.32 02:46:01 PM 1 0.42 0.00 0.07 0.00 0.05 99.47 02:47:01 PM all 0.33 0.00 0.05 0.00 0.03 99.60 02:47:01 PM 0 0.57 0.00 0.05 0.00 0.03 99.35 02:47:01 PM 1 0.08 0.00 0.05 0.00 0.02 99.85 02:48:01 PM all 4.41 0.00 3.91 0.00 0.04 91.63 02:48:01 PM 0 7.06 0.00 7.87 0.00 0.05 85.02 02:48:01 PM 1 1.90 0.00 0.17 0.00 0.03 97.90 02:49:01 PM all 7.12 0.00 1.43 0.00 0.07 91.39 02:49:01 PM 0 14.22 0.00 2.87 0.00 0.07 82.84 02:49:01 PM 1 0.60 0.00 0.10 0.00 0.07 99.23 02:50:01 PM all 0.34 0.00 0.06 0.00 0.03 99.57 02:50:01 PM 0 0.12 0.00 0.07 0.00 0.03 99.78 02:50:01 PM 1 0.57 0.00 0.05 0.00 0.03 99.35 02:51:01 PM all 0.36 0.00 0.08 0.00 0.03 99.52 02:51:01 PM 0 0.53 0.00 0.10 0.00 0.05 99.32 02:51:01 PM 1 0.18 0.00 0.07 0.00 0.02 99.73 02:52:01 PM all 6.36 0.00 1.54 0.00 0.06 92.04 02:52:01 PM 0 12.83 0.00 3.06 0.00 0.05 84.06 02:52:01 PM 1 0.43 0.00 0.15 0.00 0.07 99.35 02:53:01 PM all 6.81 0.00 2.43 0.00 0.06 90.70 02:53:01 PM 0 1.50 0.00 0.13 0.00 0.05 98.32 02:53:01 PM 1 12.53 0.00 4.89 0.00 0.07 82.51 02:53:01 PM CPU %user %nice %system %iowait %steal %idle 02:54:01 PM all 6.70 0.00 1.50 0.00 0.06 91.74 02:54:01 PM 0 13.36 0.00 2.99 0.00 0.07 83.57 02:54:01 PM 1 0.63 0.00 0.15 0.00 0.05 99.17 02:55:01 PM all 3.53 0.00 1.48 0.00 0.05 94.95 02:55:01 PM 0 6.56 0.00 2.92 0.00 0.05 90.47 02:55:01 PM 1 0.60 0.00 0.08 0.00 0.05 99.27 02:56:01 PM all 0.34 0.00 0.07 0.00 0.03 99.56 02:56:01 PM 0 0.17 0.00 0.10 0.00 0.05 99.68 02:56:01 PM 1 0.52 0.00 0.03 0.00 0.02 99.43 02:57:01 PM all 4.13 0.00 0.31 0.00 0.05 95.51 02:57:01 PM 0 1.07 0.00 0.17 0.00 0.05 98.71 02:57:01 PM 1 7.29 0.00 0.45 0.00 0.05 92.21 02:58:01 PM all 5.76 0.00 2.25 0.00 0.07 91.93 02:58:01 PM 0 4.30 0.00 0.27 0.00 0.07 95.36 02:58:01 PM 1 7.26 0.00 4.30 0.00 0.07 88.37 02:59:01 PM all 4.24 0.00 0.31 0.00 0.07 95.39 02:59:01 PM 0 4.98 0.00 0.37 0.00 0.07 94.59 02:59:01 PM 1 3.50 0.00 0.25 0.00 0.07 96.18 03:00:01 PM all 4.21 0.00 0.29 0.00 0.08 95.42 03:00:01 PM 0 6.52 0.00 0.40 0.00 0.08 92.99 03:00:01 PM 1 1.90 0.00 0.18 0.00 0.07 97.85 03:01:01 PM all 4.19 0.00 0.33 0.00 0.07 95.41 03:01:01 PM 0 4.69 0.00 0.33 0.00 0.07 94.91 03:01:01 PM 1 3.70 0.00 0.32 0.00 0.07 95.92 03:02:01 PM all 4.31 0.00 0.33 0.00 0.07 95.30 03:02:01 PM 0 3.61 0.00 0.27 0.00 0.07 96.05 03:02:01 PM 1 5.00 0.00 0.38 0.00 0.07 94.55 03:03:01 PM all 4.07 0.00 0.30 0.00 0.07 95.57 03:03:01 PM 0 4.02 0.00 0.30 0.00 0.07 95.61 03:03:01 PM 1 4.11 0.00 0.30 0.00 0.07 95.52 03:04:01 PM all 6.35 0.00 0.36 0.00 0.07 93.22 03:04:01 PM 0 5.54 0.00 0.28 0.00 0.07 94.10 03:04:01 PM 1 7.15 0.00 0.44 0.00 0.07 92.34 03:04:01 PM CPU %user %nice %system %iowait %steal %idle 03:05:01 PM all 0.53 0.00 0.08 0.00 0.03 99.36 03:05:01 PM 0 0.50 0.00 0.08 0.00 0.03 99.38 03:05:01 PM 1 0.57 0.00 0.07 0.00 0.03 99.33 03:06:01 PM all 0.33 0.00 0.05 0.00 0.04 99.57 03:06:01 PM 0 0.10 0.00 0.07 0.00 0.05 99.78 03:06:01 PM 1 0.57 0.00 0.03 0.00 0.03 99.37 03:07:01 PM all 0.50 0.00 0.06 0.00 0.04 99.40 03:07:01 PM 0 0.45 0.00 0.08 0.00 0.05 99.42 03:07:01 PM 1 0.55 0.00 0.03 0.00 0.03 99.38 03:08:01 PM all 0.32 0.00 0.07 0.00 0.03 99.58 03:08:01 PM 0 0.10 0.00 0.08 0.00 0.05 99.77 03:08:01 PM 1 0.53 0.00 0.05 0.00 0.02 99.40 03:09:01 PM all 0.48 0.00 0.06 0.00 0.05 99.41 03:09:01 PM 0 0.42 0.00 0.08 0.00 0.07 99.43 03:09:01 PM 1 0.55 0.00 0.03 0.00 0.03 99.38 03:10:02 PM all 0.33 0.00 0.08 0.00 0.04 99.56 03:10:02 PM 0 0.13 0.00 0.10 0.00 0.05 99.72 03:10:02 PM 1 0.52 0.00 0.05 0.00 0.03 99.40 03:11:01 PM all 1.48 0.00 0.12 0.00 0.04 98.36 03:11:01 PM 0 2.14 0.00 0.19 0.00 0.05 97.62 03:11:01 PM 1 0.81 0.00 0.05 0.00 0.03 99.10 03:12:01 PM all 6.51 0.00 3.92 0.00 0.07 89.50 03:12:01 PM 0 2.52 0.00 0.39 0.00 0.07 97.02 03:12:01 PM 1 10.74 0.00 7.66 0.00 0.07 81.53 03:13:01 PM all 4.04 0.00 1.34 0.00 0.05 94.56 03:13:01 PM 0 7.63 0.00 2.65 0.00 0.05 89.66 03:13:01 PM 1 0.62 0.00 0.08 0.00 0.05 99.25 03:14:01 PM all 0.36 0.00 0.08 0.01 0.04 99.52 03:14:01 PM 0 0.10 0.00 0.05 0.02 0.03 99.80 03:14:01 PM 1 0.62 0.00 0.10 0.00 0.05 99.23 03:15:01 PM all 2.58 0.00 0.52 0.00 0.04 96.86 03:15:01 PM 0 5.02 0.00 0.93 0.00 0.05 93.99 03:15:01 PM 1 0.22 0.00 0.12 0.00 0.03 99.63 03:15:01 PM CPU %user %nice %system %iowait %steal %idle 03:16:01 PM all 2.12 0.00 1.21 0.00 0.06 96.61 03:16:01 PM 0 3.84 0.00 2.37 0.00 0.09 93.70 03:16:01 PM 1 0.43 0.00 0.08 0.00 0.03 99.45 03:17:01 PM all 5.22 0.00 1.34 0.00 0.05 93.39 03:17:01 PM 0 10.13 0.00 2.67 0.00 0.05 87.14 03:17:01 PM 1 0.60 0.00 0.08 0.00 0.05 99.27 03:18:01 PM all 0.35 0.00 0.07 0.00 0.05 99.53 03:18:01 PM 0 0.10 0.00 0.08 0.00 0.05 99.77 03:18:01 PM 1 0.60 0.00 0.05 0.00 0.05 99.30 03:19:01 PM all 0.18 0.00 0.07 0.00 0.03 99.72 03:19:01 PM 0 0.08 0.00 0.07 0.00 0.03 99.82 03:19:01 PM 1 0.28 0.00 0.07 0.00 0.03 99.61 03:20:01 PM all 7.48 0.00 2.67 0.00 0.07 89.78 03:20:01 PM 0 4.11 0.00 0.29 0.00 0.07 95.53 03:20:01 PM 1 10.99 0.00 5.14 0.00 0.07 83.79 03:21:01 PM all 4.30 0.00 0.31 0.01 0.08 95.31 03:21:01 PM 0 5.93 0.00 0.39 0.00 0.08 93.60 03:21:01 PM 1 2.67 0.00 0.23 0.02 0.07 97.01 03:22:01 PM all 4.28 0.00 0.29 0.00 0.08 95.35 03:22:01 PM 0 3.41 0.00 0.25 0.00 0.07 96.27 03:22:01 PM 1 5.15 0.00 0.33 0.00 0.08 94.43 03:23:01 PM all 4.27 0.00 0.32 0.00 0.08 95.33 03:23:01 PM 0 3.83 0.00 0.27 0.00 0.07 95.83 03:23:01 PM 1 4.72 0.00 0.37 0.00 0.08 94.83 03:24:01 PM all 4.32 0.00 0.30 0.00 0.07 95.32 03:24:01 PM 0 5.43 0.00 0.35 0.00 0.08 94.14 03:24:01 PM 1 3.21 0.00 0.25 0.00 0.05 96.49 03:25:01 PM all 4.22 0.00 0.32 0.00 0.06 95.41 03:25:01 PM 0 5.38 0.00 0.37 0.00 0.07 94.19 03:25:01 PM 1 3.06 0.00 0.27 0.00 0.05 96.62 03:26:01 PM all 4.30 0.00 0.32 0.00 0.08 95.29 03:26:01 PM 0 1.89 0.00 0.22 0.00 0.07 97.83 03:26:01 PM 1 6.72 0.00 0.42 0.00 0.10 92.76 03:26:01 PM CPU %user %nice %system %iowait %steal %idle 03:27:01 PM all 5.09 0.00 0.27 0.00 0.07 94.58 03:27:01 PM 0 6.43 0.00 0.28 0.00 0.07 93.22 03:27:01 PM 1 3.75 0.00 0.25 0.00 0.07 95.94 03:28:01 PM all 0.36 0.00 0.05 0.00 0.04 99.55 03:28:01 PM 0 0.08 0.00 0.05 0.00 0.05 99.82 03:28:01 PM 1 0.63 0.00 0.05 0.00 0.03 99.28 03:29:01 PM all 0.32 0.00 0.06 0.00 0.03 99.60 03:29:01 PM 0 0.07 0.00 0.05 0.00 0.03 99.85 03:29:01 PM 1 0.57 0.00 0.07 0.00 0.02 99.35 03:30:01 PM all 0.49 0.00 0.08 0.00 0.04 99.38 03:30:01 PM 0 0.42 0.00 0.08 0.00 0.05 99.45 03:30:01 PM 1 0.57 0.00 0.08 0.00 0.03 99.32 03:31:01 PM all 0.18 0.00 0.06 0.00 0.03 99.73 03:31:01 PM 0 0.12 0.00 0.07 0.00 0.02 99.80 03:31:01 PM 1 0.25 0.00 0.05 0.00 0.03 99.67 03:32:01 PM all 0.52 0.00 0.07 0.00 0.03 99.38 03:32:01 PM 0 0.45 0.00 0.07 0.00 0.03 99.45 03:32:01 PM 1 0.58 0.00 0.07 0.00 0.03 99.32 03:33:01 PM all 0.25 0.00 0.08 0.00 0.04 99.63 03:33:01 PM 0 0.07 0.00 0.05 0.00 0.03 99.85 03:33:01 PM 1 0.43 0.00 0.10 0.00 0.05 99.42 03:34:01 PM all 4.13 0.00 3.94 0.00 0.03 91.90 03:34:01 PM 0 1.85 0.00 0.18 0.00 0.03 97.93 03:34:01 PM 1 6.38 0.00 7.66 0.00 0.03 85.93 03:35:01 PM all 7.17 0.00 2.12 0.00 0.08 90.63