Started by upstream project "integration-distribution-mri-test-scandium" build number 77 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-centos8-robot-2c-8g-3091 (centos8-robot-2c-8g) in workspace /w/workspace/controller-csit-3node-clustering-tell-all-scandium [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-xmScw3AziXxu/agent.5282 SSH_AGENT_PID=5283 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_15947773358004184848.key (/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/private_key_15947773358004184848.key) [ssh-agent] Using credentials jenkins (Release Engineering Jenkins Key) The recommended git tool is: NONE using credential opendaylight-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://devvexx.opendaylight.org/mirror/integration/test > git init /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test > git --version # timeout=10 > git --version # 'git version 2.43.0' using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh8339991895393331217.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/integration/test # timeout=10 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/integration/test using GIT_SSH to set credentials Release Engineering Jenkins Key [INFO] Currently running in a labeled security context [INFO] Currently SELinux is 'enforcing' on the host > /usr/bin/chcon --type=ssh_home_t /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test@tmp/jenkins-gitclient-ssh11903216227972986481.key Verifying host key using known hosts file You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/integration/test master # timeout=10 > git rev-parse FETCH_HEAD^{commit} # timeout=10 Checking out Revision 6c60ddfc8acc87c45ab0767b2ba1d2c4e7d34388 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 6c60ddfc8acc87c45ab0767b2ba1d2c4e7d34388 # timeout=10 Commit message: "Adapt test for new pce-allocation field" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 62cb016f4f4171033927cf2ae7f4ac5095373e88 # timeout=10 No emails were triggered. provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins9892986744835246798.sh ---> python-tools-install.sh Setup pyenv: system * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.13 (set by /opt/pyenv/version) * 3.11.7 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-llNL lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH Generating Requirements File ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. Python 3.11.7 pip 25.2 from /tmp/venv-llNL/lib/python3.11/site-packages/pip (python 3.11) appdirs==1.4.4 argcomplete==3.6.2 aspy.yaml==1.3.0 attrs==25.4.0 autopage==0.5.2 beautifulsoup4==4.14.2 boto3==1.40.50 botocore==1.40.50 bs4==0.0.2 cachetools==6.2.1 certifi==2025.10.5 cffi==2.0.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.4.3 click==8.3.0 cliff==4.11.0 cmd2==2.7.0 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.2.1 defusedxml==0.7.1 Deprecated==1.2.18 distlib==0.4.0 dnspython==2.8.0 docker==7.1.0 dogpile.cache==1.5.0 durationpy==0.10 email-validator==2.3.0 filelock==3.20.0 future==1.0.0 gitdb==4.0.12 GitPython==3.1.45 google-auth==2.41.1 httplib2==0.31.0 identify==2.6.15 idna==3.11 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.6 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.25.1 jsonschema-specifications==2025.9.1 keystoneauth1==5.12.0 kubernetes==34.1.0 lftools==0.37.15 lxml==6.0.2 markdown-it-py==4.0.0 MarkupSafe==3.0.3 mdurl==0.1.2 msgpack==1.1.2 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 niet==1.4.2 nodeenv==1.9.1 oauth2client==4.1.3 oauthlib==3.3.1 openstacksdk==4.7.1 os-service-types==1.8.0 osc-lib==4.2.0 oslo.config==10.0.0 oslo.context==6.1.0 oslo.i18n==6.6.0 oslo.log==7.2.1 oslo.serialization==5.8.0 oslo.utils==9.1.0 packaging==25.0 pbr==7.0.1 platformdirs==4.5.0 prettytable==3.16.0 psutil==7.1.0 pyasn1==0.6.1 pyasn1_modules==0.4.2 pycparser==2.23 pygerrit2==2.0.15 PyGithub==2.8.1 Pygments==2.19.2 PyJWT==2.10.1 PyNaCl==1.6.0 pyparsing==2.4.7 pyperclip==1.11.0 pyrsistent==0.20.0 python-cinderclient==9.8.0 python-dateutil==2.9.0.post0 python-heatclient==4.3.0 python-jenkins==1.8.3 python-keystoneclient==5.7.0 python-magnumclient==4.9.0 python-openstackclient==8.2.0 python-swiftclient==4.8.0 PyYAML==6.0.3 referencing==0.36.2 requests==2.32.5 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rich==14.2.0 rich-argparse==1.7.1 rpds-py==0.27.1 rsa==4.9.1 ruamel.yaml==0.18.15 ruamel.yaml.clib==0.2.14 s3transfer==0.14.0 simplejson==3.20.2 six==1.17.0 smmap==5.0.2 soupsieve==2.8 stevedore==5.5.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.13.3 tqdm==4.67.1 typing_extensions==4.15.0 tzdata==2025.2 urllib3==1.26.20 virtualenv==20.35.3 wcwidth==0.2.14 websocket-client==1.9.0 wrapt==1.17.3 xdg==6.0.0 xmltodict==1.0.2 yq==3.4.3 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_STACK_TEMPLATE=csit-2-instance-type.yaml OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-77 OS_STACK_TEMPLATE_DIR=openstack-hot [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins14232650178348177228.sh ---> Create parameters file for OpenStack HOT OpenStack Heat parameters generated ----------------------------------- parameters: vm_0_count: '3' vm_0_flavor: 'v3-standard-4' vm_0_image: 'ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250917-133034.447' vm_1_count: '0' vm_1_flavor: 'v3-standard-2' vm_1_image: 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 - 20250917-133034.654' job_name: '43164-77' silo: 'releng' [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins16962374752027162268.sh ---> Create HEAT stack + source /home/jenkins/lf-env.sh + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ++ mktemp -d /tmp/venv-XXXX + lf_venv=/tmp/venv-Glvp + local venv_file=/tmp/.os_lf_venv + local python=python3 + local options + local set_path=true + local install_args= ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''urllib3~=1.26.15'\'' '\''yq'\''' ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + true + case $1 in + python=python3 + shift 2 + true + case $1 in + shift + break + case $python in + local pkg_list= + [[ -d /opt/pyenv ]] + echo 'Setup pyenv:' Setup pyenv: + export PYENV_ROOT=/opt/pyenv + PYENV_ROOT=/opt/pyenv + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + pyenv versions system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) + command -v pyenv ++ pyenv init - --no-rehash + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\'''\''/opt/pyenv/shims'\'''\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')" export PATH="/opt/pyenv/shims:${PATH}" export PYENV_SHELL=bash source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\'' pyenv() { local command command="${1:-}" if [ "$#" -gt 0 ]; then shift fi case "$command" in rehash|shell) eval "$(pyenv "sh-$command" "$@")" ;; *) command pyenv "$command" "$@" ;; esac }' +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"' ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin ++ export PYENV_SHELL=bash ++ PYENV_SHELL=bash ++ source /opt/pyenv/libexec/../completions/pyenv.bash +++ complete -F _pyenv pyenv ++ lf-pyver python3 ++ local py_version_xy=python3 ++ local py_version_xyz= ++ awk '{ print $1 }' ++ pyenv versions ++ local command ++ command=versions ++ '[' 1 -gt 0 ']' ++ shift ++ case "$command" in ++ command pyenv versions ++ pyenv versions ++ sed 's/^[ *]* //' ++ grep -E '^[0-9.]*[0-9]$' ++ [[ ! -s /tmp/.pyenv_versions ]] +++ grep '^3' /tmp/.pyenv_versions +++ sort -V +++ tail -n 1 ++ py_version_xyz=3.11.7 ++ [[ -z 3.11.7 ]] ++ echo 3.11.7 ++ return 0 + pyenv local 3.11.7 + local command + command=local + '[' 2 -gt 0 ']' + shift + case "$command" in + command pyenv local 3.11.7 + pyenv local 3.11.7 + for arg in "$@" + case $arg in + pkg_list+='lftools[openstack] ' + for arg in "$@" + case $arg in + pkg_list+='kubernetes ' + for arg in "$@" + case $arg in + pkg_list+='niet ' + for arg in "$@" + case $arg in + pkg_list+='python-heatclient ' + for arg in "$@" + case $arg in + pkg_list+='python-openstackclient ' + for arg in "$@" + case $arg in + pkg_list+='python-magnumclient ' + for arg in "$@" + case $arg in + pkg_list+='urllib3~=1.26.15 ' + for arg in "$@" + case $arg in + pkg_list+='yq ' + [[ -f /tmp/.os_lf_venv ]] ++ cat /tmp/.os_lf_venv + lf_venv=/tmp/venv-llNL + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from' file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from file:/tmp/.os_lf_venv + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)' lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) + local 'pip_opts=--upgrade --quiet' + pip_opts='--upgrade --quiet --trusted-host pypi.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org' + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org' + [[ -n '' ]] + [[ -n '' ]] + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...' lf-activate-venv(): INFO: Attempting to install with network-safe options... + /tmp/venv-llNL/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv + echo 'lf-activate-venv(): INFO: Base packages installed successfully' lf-activate-venv(): INFO: Base packages installed successfully + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ]] + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq ' lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + /tmp/venv-llNL/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq + type python3 + true + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH' lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH + PATH=/tmp/venv-llNL/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin + return 0 + openstack --os-cloud vex limits show --absolute +--------------------------+---------+ | Name | Value | +--------------------------+---------+ | maxTotalInstances | -1 | | maxTotalCores | 450 | | maxTotalRAMSize | 1000000 | | maxServerMeta | 128 | | maxImageMeta | 128 | | maxPersonality | 5 | | maxPersonalitySize | 10240 | | maxTotalKeypairs | 100 | | maxServerGroups | 10 | | maxServerGroupMembers | 10 | | maxTotalFloatingIps | -1 | | maxSecurityGroups | -1 | | maxSecurityGroupRules | -1 | | totalRAMUsed | 483328 | | totalCoresUsed | 118 | | totalInstancesUsed | 38 | | totalFloatingIpsUsed | 0 | | totalSecurityGroupsUsed | 0 | | totalServerGroupsUsed | 0 | | maxTotalVolumes | -1 | | maxTotalSnapshots | 10 | | maxTotalVolumeGigabytes | 4096 | | maxTotalBackups | 10 | | maxTotalBackupGigabytes | 1000 | | totalVolumesUsed | 0 | | totalGigabytesUsed | 0 | | totalSnapshotsUsed | 0 | | totalBackupsUsed | 0 | | totalBackupGigabytesUsed | 0 | +--------------------------+---------+ + pushd /opt/ciman/openstack-hot /opt/ciman/openstack-hot /w/workspace/controller-csit-3node-clustering-tell-all-scandium + lftools openstack --os-cloud vex stack create releng-controller-csit-3node-clustering-tell-all-scandium-77 csit-2-instance-type.yaml /w/workspace/controller-csit-3node-clustering-tell-all-scandium/stack-parameters.yaml Creating stack releng-controller-csit-3node-clustering-tell-all-scandium-77 Waiting to initialize infrastructure... Waiting to initialize infrastructure... Stack initialization successful. ------------------------------------ Stack Details ------------------------------------ {'added': None, 'capabilities': [], 'created_at': '2025-10-12T23:49:11Z', 'deleted': None, 'deleted_at': None, 'description': 'No description', 'environment': None, 'environment_files': None, 'files': None, 'files_container': None, 'id': '7e57bbf8-a8fb-40b1-b6c7-76553a49545d', 'is_rollback_disabled': True, 'links': [{'href': 'https://orchestration.public.mtl1.vexxhost.net/v1/12c36e260d8e4bb2913965203b1b491f/stacks/releng-controller-csit-3node-clustering-tell-all-scandium-77/7e57bbf8-a8fb-40b1-b6c7-76553a49545d', 'rel': 'self'}], 'location': Munch({'cloud': 'vex', 'region_name': 'ca-ymq-1', 'zone': None, 'project': Munch({'id': '12c36e260d8e4bb2913965203b1b491f', 'name': '61975f2c-7c17-4d69-82fa-c3ae420ad6fd', 'domain_id': None, 'domain_name': 'Default'})}), 'name': 'releng-controller-csit-3node-clustering-tell-all-scandium-77', 'notification_topics': [], 'outputs': [{'description': 'IP addresses of the 2nd vm types', 'output_key': 'vm_1_ips', 'output_value': []}, {'description': 'IP addresses of the 1st vm types', 'output_key': 'vm_0_ips', 'output_value': ['10.30.171.179', '10.30.170.102', '10.30.170.28']}], 'owner_id': ****, 'parameters': {'OS::project_id': '12c36e260d8e4bb2913965203b1b491f', 'OS::stack_id': '7e57bbf8-a8fb-40b1-b6c7-76553a49545d', 'OS::stack_name': 'releng-controller-csit-3node-clustering-tell-all-scandium-77', 'job_name': '43164-77', 'silo': 'releng', 'vm_0_count': '3', 'vm_0_flavor': 'v3-standard-4', 'vm_0_image': 'ZZCI - Ubuntu 22.04 - builder - x86_64 - ' '20250917-133034.447', 'vm_1_count': '0', 'vm_1_flavor': 'v3-standard-2', 'vm_1_image': 'ZZCI - Ubuntu 22.04 - mininet-ovs-217 - x86_64 ' '- 20250917-133034.654'}, 'parent_id': None, 'replaced': None, 'status': 'CREATE_COMPLETE', 'status_reason': 'Stack CREATE completed successfully', 'tags': [], 'template': None, 'template_description': 'No description', 'template_url': None, 'timeout_mins': 15, 'unchanged': None, 'updated': None, 'updated_at': None, 'user_project_id': '99b8043a482e4972ad25b5eaa171853a'} ------------------------------------ + popd /w/workspace/controller-csit-3node-clustering-tell-all-scandium [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins17042924348183108986.sh ---> Copy SSH public keys to CSIT lab Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH SSH not responding on 10.30.171.179. Retrying in 10 seconds... SSH not responding on 10.30.170.102. Retrying in 10 seconds... SSH not responding on 10.30.170.28. Retrying in 10 seconds... Ping to 10.30.171.179 successful. Ping to 10.30.170.102 successful. SSH not responding on 10.30.171.179. Retrying in 10 seconds... Ping to 10.30.170.28 successful. Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. releng-43164-77-0-builder-1 Successfully copied public keys to slave 10.30.170.102 Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. releng-43164-77-0-builder-2 Successfully copied public keys to slave 10.30.170.28 Ping to 10.30.171.179 successful. SSH not responding on 10.30.171.179. Retrying in 10 seconds... Ping to 10.30.171.179 successful. Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. releng-43164-77-0-builder-0 Successfully copied public keys to slave 10.30.171.179 Process 6506 ready. Process 6507 ready. Process 6508 ready. SSH ready on all stack servers. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins4824167520800407056.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-gcEg lf-activate-venv(): INFO: Save venv in file: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.robot_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: setuptools wheel lf-activate-venv(): INFO: Adding /tmp/venv-gcEg/bin to PATH + echo 'Installing Python Requirements' Installing Python Requirements + cat + python -m pip install -r requirements.txt Looking in indexes: https://nexus3.opendaylight.org/repository/PyPi/simple Collecting docker-py (from -r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-py/1.10.6/docker_py-1.10.6-py2.py3-none-any.whl (50 kB) Collecting ipaddr (from -r requirements.txt (line 2)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ipaddr/2.2.0/ipaddr-2.2.0.tar.gz (26 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting netaddr (from -r requirements.txt (line 3)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/netaddr/1.3.0/netaddr-1.3.0-py3-none-any.whl (2.3 MB) Collecting netifaces (from -r requirements.txt (line 4)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/netifaces/0.11.0/netifaces-0.11.0.tar.gz (30 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting pyhocon (from -r requirements.txt (line 5)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyhocon/0.3.61/pyhocon-0.3.61-py3-none-any.whl (25 kB) Collecting requests (from -r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/requests/2.32.5/requests-2.32.5-py3-none-any.whl (64 kB) Collecting robotframework (from -r requirements.txt (line 7)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework/7.3.2/robotframework-7.3.2-py3-none-any.whl (795 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 795.1/795.1 kB 8.1 MB/s 0:00:00 Collecting robotframework-httplibrary (from -r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-httplibrary/0.4.2/robotframework-httplibrary-0.4.2.tar.gz (9.1 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting robotframework-requests==0.9.7 (from -r requirements.txt (line 9)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-requests/0.9.7/robotframework_requests-0.9.7-py3-none-any.whl (21 kB) Collecting robotframework-selenium2library (from -r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-selenium2library/3.0.0/robotframework_selenium2library-3.0.0-py2.py3-none-any.whl (6.2 kB) Collecting robotframework-sshlibrary==3.8.0 (from -r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-sshlibrary/3.8.0/robotframework-sshlibrary-3.8.0.tar.gz (51 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting scapy (from -r requirements.txt (line 12)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scapy/2.6.1/scapy-2.6.1-py3-none-any.whl (2.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 8.1 MB/s 0:00:00 Collecting jsonpath-rw (from -r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpath-rw/1.4.0/jsonpath-rw-1.4.0.tar.gz (13 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/9.1.1/elasticsearch-9.1.1-py3-none-any.whl (937 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 937.5/937.5 kB 3.2 MB/s 0:00:00 Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.18.0/elasticsearch_dsl-8.18.0-py3-none-any.whl (10 kB) Collecting pyangbind (from -r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyangbind/0.8.6/pyangbind-0.8.6-py3-none-any.whl (52 kB) Collecting isodate (from -r requirements.txt (line 25)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/isodate/0.7.2/isodate-0.7.2-py3-none-any.whl (22 kB) Collecting jmespath (from -r requirements.txt (line 28)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jmespath/1.0.1/jmespath-1.0.1-py3-none-any.whl (20 kB) Collecting jsonpatch (from -r requirements.txt (line 31)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpatch/1.33/jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Collecting paramiko>=1.15.3 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/paramiko/4.0.0/paramiko-4.0.0-py3-none-any.whl (223 kB) Collecting scp>=0.13.0 (from robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/scp/0.15.0/scp-0.15.0-py2.py3-none-any.whl (8.8 kB) Collecting docker-pycreds>=0.2.1 (from docker-py->-r requirements.txt (line 1)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/docker-pycreds/0.4.0/docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB) Collecting six>=1.4.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/six/1.17.0/six-1.17.0-py2.py3-none-any.whl (11 kB) Collecting websocket-client>=0.32.0 (from docker-py->-r requirements.txt (line 1)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/websocket-client/1.9.0/websocket_client-1.9.0-py3-none-any.whl (82 kB) Collecting pyparsing<4,>=2 (from pyhocon->-r requirements.txt (line 5)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pyparsing/3.2.5/pyparsing-3.2.5-py3-none-any.whl (113 kB) Collecting charset_normalizer<4,>=2 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/charset-normalizer/3.4.3/charset_normalizer-3.4.3-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (150 kB) Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/idna/3.11/idna-3.11-py3-none-any.whl (71 kB) Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 6)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/urllib3/2.5.0/urllib3-2.5.0-py3-none-any.whl (129 kB) Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 6)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/certifi/2025.10.5/certifi-2025.10.5-py3-none-any.whl (163 kB) Collecting webtest>=2.0 (from robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webtest/3.0.7/webtest-3.0.7-py3-none-any.whl (32 kB) Collecting jsonpointer (from robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/jsonpointer/3.0.0/jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB) Collecting robotframework-seleniumlibrary>=3.0.0 (from robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-seleniumlibrary/6.8.0/robotframework_seleniumlibrary-6.8.0-py3-none-any.whl (104 kB) Collecting ply (from jsonpath-rw->-r requirements.txt (line 15)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/ply/3.11/ply-3.11-py2.py3-none-any.whl (49 kB) Collecting decorator (from jsonpath-rw->-r requirements.txt (line 15)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/decorator/5.2.1/decorator-5.2.1-py3-none-any.whl (9.2 kB) Collecting elastic-transport<10,>=9.1.0 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/9.1.0/elastic_transport-9.1.0-py3-none-any.whl (65 kB) Collecting python-dateutil (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/python-dateutil/2.9.0.post0/python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting typing-extensions (from elasticsearch->-r requirements.txt (line 18)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/typing-extensions/4.15.0/typing_extensions-4.15.0-py3-none-any.whl (44 kB) Collecting elasticsearch (from -r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch/8.19.1/elasticsearch-8.19.1-py3-none-any.whl (940 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 940.5/940.5 kB 16.6 MB/s 0:00:00 INFO: pip is looking at multiple versions of elasticsearch-dsl to determine which version is compatible with other requirements. This could take a while. Collecting elasticsearch-dsl (from -r requirements.txt (line 19)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.1/elasticsearch_dsl-8.17.1-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.17.0/elasticsearch_dsl-8.17.0-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.16.0/elasticsearch_dsl-8.16.0-py3-none-any.whl (158 kB) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elasticsearch-dsl/8.15.4/elasticsearch_dsl-8.15.4-py3-none-any.whl (104 kB) Collecting elastic-transport<9,>=8.15.1 (from elasticsearch->-r requirements.txt (line 18)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/elastic-transport/8.17.1/elastic_transport-8.17.1-py3-none-any.whl (64 kB) Collecting pyang (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pyang/2.7.1/pyang-2.7.1-py2.py3-none-any.whl (598 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 598.5/598.5 kB 21.6 MB/s 0:00:00 Collecting lxml (from pyangbind->-r requirements.txt (line 22)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/lxml/6.0.2/lxml-6.0.2-cp311-cp311-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.2 MB) Collecting regex (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/regex/2025.9.18/regex-2025.9.18-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (798 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 799.0/799.0 kB 28.6 MB/s 0:00:00 Collecting enum34 (from pyangbind->-r requirements.txt (line 22)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/enum34/1.1.10/enum34-1.1.10-py3-none-any.whl (11 kB) Collecting bcrypt>=3.2 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/bcrypt/5.0.0/bcrypt-5.0.0-cp39-abi3-manylinux_2_28_x86_64.whl (278 kB) Collecting cryptography>=3.3 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cryptography/46.0.2/cryptography-46.0.2-cp311-abi3-manylinux_2_28_x86_64.whl (4.5 MB) Collecting invoke>=2.0 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/invoke/2.2.1/invoke-2.2.1-py3-none-any.whl (160 kB) Collecting pynacl>=1.5 (from paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pynacl/1.6.0/pynacl-1.6.0-cp38-abi3-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (1.4 MB) Collecting cffi>=2.0.0 (from cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/cffi/2.0.0/cffi-2.0.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (215 kB) Collecting pycparser (from cffi>=2.0.0->cryptography>=3.3->paramiko>=1.15.3->robotframework-sshlibrary==3.8.0->-r requirements.txt (line 11)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/pycparser/2.23/pycparser-2.23-py3-none-any.whl (118 kB) Collecting selenium>=4.3.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/selenium/4.36.0/selenium-4.36.0-py3-none-any.whl (9.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.6/9.6 MB 42.3 MB/s 0:00:00 Collecting robotframework-pythonlibcore>=4.4.1 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/robotframework-pythonlibcore/4.4.1/robotframework_pythonlibcore-4.4.1-py2.py3-none-any.whl (12 kB) Collecting click>=8.0 (from robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/click/8.3.0/click-8.3.0-py3-none-any.whl (107 kB) Collecting trio<1.0,>=0.30.0 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio/0.31.0/trio-0.31.0-py3-none-any.whl (512 kB) Collecting trio-websocket<1.0,>=0.12.2 (from selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/trio-websocket/0.12.2/trio_websocket-0.12.2-py3-none-any.whl (21 kB) Collecting attrs>=23.2.0 (from trio<1.0,>=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/attrs/25.4.0/attrs-25.4.0-py3-none-any.whl (67 kB) Collecting sortedcontainers (from trio<1.0,>=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sortedcontainers/2.4.0/sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting outcome (from trio<1.0,>=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/outcome/1.3.0.post0/outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Collecting sniffio>=1.3.0 (from trio<1.0,>=0.30.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/sniffio/1.3.1/sniffio-1.3.1-py3-none-any.whl (10 kB) Collecting wsproto>=0.14 (from trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/wsproto/1.2.0/wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting pysocks!=1.5.7,<2.0,>=1.5.6 (from urllib3[socks]<3.0,>=2.5.0->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/pysocks/1.7.1/PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting WebOb>=1.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/webob/1.8.9/WebOb-1.8.9-py2.py3-none-any.whl (115 kB) Collecting waitress>=3.0.2 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/waitress/3.0.2/waitress-3.0.2-py3-none-any.whl (56 kB) Collecting beautifulsoup4 (from webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/beautifulsoup4/4.14.2/beautifulsoup4-4.14.2-py3-none-any.whl (106 kB) Collecting h11<1,>=0.9.0 (from wsproto>=0.14->trio-websocket<1.0,>=0.12.2->selenium>=4.3.0->robotframework-seleniumlibrary>=3.0.0->robotframework-selenium2library->-r requirements.txt (line 10)) Downloading https://nexus3.opendaylight.org/repository/PyPi/packages/h11/0.16.0/h11-0.16.0-py3-none-any.whl (37 kB) Collecting soupsieve>1.2 (from beautifulsoup4->webtest>=2.0->robotframework-httplibrary->-r requirements.txt (line 8)) Using cached https://nexus3.opendaylight.org/repository/PyPi/packages/soupsieve/2.8/soupsieve-2.8-py3-none-any.whl (36 kB) Building wheels for collected packages: robotframework-sshlibrary, ipaddr, netifaces, robotframework-httplibrary, jsonpath-rw DEPRECATION: Building 'robotframework-sshlibrary' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'robotframework-sshlibrary'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for robotframework-sshlibrary (setup.py): started Building wheel for robotframework-sshlibrary (setup.py): finished with status 'done' Created wheel for robotframework-sshlibrary: filename=robotframework_sshlibrary-3.8.0-py3-none-any.whl size=55205 sha256=a011cd05eee9609781c47e08e3c7a637f2f87ff35929756064df778e4a2f72ac Stored in directory: /home/jenkins/.cache/pip/wheels/f7/c9/b3/a977b7bcc410d45ae27d240df3d00a12585509180e373ecccc DEPRECATION: Building 'ipaddr' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'ipaddr'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for ipaddr (setup.py): started Building wheel for ipaddr (setup.py): finished with status 'done' Created wheel for ipaddr: filename=ipaddr-2.2.0-py3-none-any.whl size=18353 sha256=04bf467fb44a7890c98f764d346e7df5ce11b0ec7bb7a763341cb4b7af5a9be0 Stored in directory: /home/jenkins/.cache/pip/wheels/dc/6c/04/da2d847fa8d45c59af3e1d83e2acc29cb8adcbaf04c0898dbf DEPRECATION: Building 'netifaces' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'netifaces'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for netifaces (setup.py): started Building wheel for netifaces (setup.py): finished with status 'done' Created wheel for netifaces: filename=netifaces-0.11.0-cp311-cp311-linux_x86_64.whl size=41084 sha256=a8a561ba11173fcc9088f36a8a30b6d18cf57c1c80baf73e15f813d9b383652a Stored in directory: /home/jenkins/.cache/pip/wheels/f8/18/88/e61d54b995bea304bdb1d040a92b72228a1bf72ca2a3eba7c9 DEPRECATION: Building 'robotframework-httplibrary' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'robotframework-httplibrary'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for robotframework-httplibrary (setup.py): started Building wheel for robotframework-httplibrary (setup.py): finished with status 'done' Created wheel for robotframework-httplibrary: filename=robotframework_httplibrary-0.4.2-py3-none-any.whl size=10014 sha256=d054cd70c9585e396d8705d4cd407756b02b01210ab65dd5b06f401d80c795e9 Stored in directory: /home/jenkins/.cache/pip/wheels/aa/bc/0d/9a20dd51effef392aae2733cb4c7b66c6fa29fca33d88b57ed DEPRECATION: Building 'jsonpath-rw' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'jsonpath-rw'. Discussion can be found at https://github.com/pypa/pip/issues/6334 Building wheel for jsonpath-rw (setup.py): started Building wheel for jsonpath-rw (setup.py): finished with status 'done' Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15176 sha256=bb647f469418a6ab20234086c0e503a105bfd94e9eb239a56bdd2440e92f678c Stored in directory: /home/jenkins/.cache/pip/wheels/f1/54/63/9a8da38cefae13755097b36cc852decc25d8ef69c37d58d4eb Successfully built robotframework-sshlibrary ipaddr netifaces robotframework-httplibrary jsonpath-rw Installing collected packages: sortedcontainers, ply, netifaces, ipaddr, enum34, websocket-client, WebOb, waitress, urllib3, typing-extensions, soupsieve, sniffio, six, scapy, robotframework-pythonlibcore, robotframework, regex, pysocks, pyparsing, pycparser, netaddr, lxml, jsonpointer, jmespath, isodate, invoke, idna, h11, decorator, click, charset_normalizer, certifi, bcrypt, attrs, wsproto, requests, python-dateutil, pyhocon, pyang, outcome, jsonpath-rw, jsonpatch, elastic-transport, docker-pycreds, cffi, beautifulsoup4, webtest, trio, robotframework-requests, pynacl, pyangbind, elasticsearch, docker-py, cryptography, trio-websocket, robotframework-httplibrary, paramiko, elasticsearch-dsl, selenium, scp, robotframework-sshlibrary, robotframework-seleniumlibrary, robotframework-selenium2library Successfully installed WebOb-1.8.9 attrs-25.4.0 bcrypt-5.0.0 beautifulsoup4-4.14.2 certifi-2025.10.5 cffi-2.0.0 charset_normalizer-3.4.3 click-8.3.0 cryptography-46.0.2 decorator-5.2.1 docker-py-1.10.6 docker-pycreds-0.4.0 elastic-transport-8.17.1 elasticsearch-8.19.1 elasticsearch-dsl-8.15.4 enum34-1.1.10 h11-0.16.0 idna-3.11 invoke-2.2.1 ipaddr-2.2.0 isodate-0.7.2 jmespath-1.0.1 jsonpatch-1.33 jsonpath-rw-1.4.0 jsonpointer-3.0.0 lxml-6.0.2 netaddr-1.3.0 netifaces-0.11.0 outcome-1.3.0.post0 paramiko-4.0.0 ply-3.11 pyang-2.7.1 pyangbind-0.8.6 pycparser-2.23 pyhocon-0.3.61 pynacl-1.6.0 pyparsing-3.2.5 pysocks-1.7.1 python-dateutil-2.9.0.post0 regex-2025.9.18 requests-2.32.5 robotframework-7.3.2 robotframework-httplibrary-0.4.2 robotframework-pythonlibcore-4.4.1 robotframework-requests-0.9.7 robotframework-selenium2library-3.0.0 robotframework-seleniumlibrary-6.8.0 robotframework-sshlibrary-3.8.0 scapy-2.6.1 scp-0.15.0 selenium-4.36.0 six-1.17.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.8 trio-0.31.0 trio-websocket-0.12.2 typing-extensions-4.15.0 urllib3-2.5.0 waitress-3.0.2 websocket-client-1.9.0 webtest-3.0.7 wsproto-1.2.0 + pip freeze attrs==25.4.0 bcrypt==5.0.0 beautifulsoup4==4.14.2 certifi==2025.10.5 cffi==2.0.0 charset-normalizer==3.4.3 click==8.3.0 cryptography==46.0.2 decorator==5.2.1 distlib==0.4.0 docker-py==1.10.6 docker-pycreds==0.4.0 elastic-transport==8.17.1 elasticsearch==8.19.1 elasticsearch-dsl==8.15.4 enum34==1.1.10 filelock==3.20.0 h11==0.16.0 idna==3.11 invoke==2.2.1 ipaddr==2.2.0 isodate==0.7.2 jmespath==1.0.1 jsonpatch==1.33 jsonpath-rw==1.4.0 jsonpointer==3.0.0 lxml==6.0.2 netaddr==1.3.0 netifaces==0.11.0 outcome==1.3.0.post0 paramiko==4.0.0 platformdirs==4.5.0 ply==3.11 pyang==2.7.1 pyangbind==0.8.6 pycparser==2.23 pyhocon==0.3.61 PyNaCl==1.6.0 pyparsing==3.2.5 PySocks==1.7.1 python-dateutil==2.9.0.post0 regex==2025.9.18 requests==2.32.5 robotframework==7.3.2 robotframework-httplibrary==0.4.2 robotframework-pythonlibcore==4.4.1 robotframework-requests==0.9.7 robotframework-selenium2library==3.0.0 robotframework-seleniumlibrary==6.8.0 robotframework-sshlibrary==3.8.0 scapy==2.6.1 scp==0.15.0 selenium==4.36.0 six==1.17.0 sniffio==1.3.1 sortedcontainers==2.4.0 soupsieve==2.8 trio==0.31.0 trio-websocket==0.12.2 typing_extensions==4.15.0 urllib3==2.5.0 virtualenv==20.35.3 waitress==3.0.2 WebOb==1.8.9 websocket-client==1.9.0 WebTest==3.0.7 wsproto==1.2.0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env.properties' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins3148507689991266567.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient yq ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. kubernetes 34.1.0 requires urllib3<2.4.0,>=1.24.2, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH + ODL_SYSTEM=() + TOOLS_SYSTEM=() + OPENSTACK_SYSTEM=() + OPENSTACK_CONTROLLERS=() + mapfile -t ADDR ++ jq -r '.outputs[] | select(.output_key | match("^vm_[0-9]+_ips$")) | .output_value | .[]' ++ openstack stack show -f json -c outputs releng-controller-csit-3node-clustering-tell-all-scandium-77 + for i in "${ADDR[@]}" ++ ssh 10.30.171.179 hostname -s Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + REMHOST=releng-43164-77-0-builder-0 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.102 hostname -s Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + REMHOST=releng-43164-77-0-builder-1 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + for i in "${ADDR[@]}" ++ ssh 10.30.170.28 hostname -s Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + REMHOST=releng-43164-77-0-builder-2 + case ${REMHOST} in + ODL_SYSTEM=("${ODL_SYSTEM[@]}" "${i}") + echo NUM_ODL_SYSTEM=3 + echo NUM_TOOLS_SYSTEM=0 + '[' '' == yes ']' + NUM_OPENSTACK_SYSTEM=0 + echo NUM_OPENSTACK_SYSTEM=0 + '[' 0 -eq 2 ']' + echo ODL_SYSTEM_IP=10.30.171.179 ++ seq 0 2 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_1_IP=10.30.171.179 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_2_IP=10.30.170.102 + for i in $(seq 0 $(( ${#ODL_SYSTEM[@]} - 1 ))) + echo ODL_SYSTEM_3_IP=10.30.170.28 + echo TOOLS_SYSTEM_IP= ++ seq 0 -1 + openstack_index=0 + NUM_OPENSTACK_CONTROL_NODES=1 + echo NUM_OPENSTACK_CONTROL_NODES=1 ++ seq 0 0 + for i in $(seq 0 $((NUM_OPENSTACK_CONTROL_NODES - 1))) + echo OPENSTACK_CONTROL_NODE_1_IP= + NUM_OPENSTACK_COMPUTE_NODES=-1 + echo NUM_OPENSTACK_COMPUTE_NODES=-1 + '[' -1 -ge 2 ']' ++ seq 0 -2 + NUM_OPENSTACK_HAPROXY_NODES=0 + echo NUM_OPENSTACK_HAPROXY_NODES=0 ++ seq 0 -1 + echo 'Contents of slave_addresses.txt:' Contents of slave_addresses.txt: + cat slave_addresses.txt NUM_ODL_SYSTEM=3 NUM_TOOLS_SYSTEM=0 NUM_OPENSTACK_SYSTEM=0 ODL_SYSTEM_IP=10.30.171.179 ODL_SYSTEM_1_IP=10.30.171.179 ODL_SYSTEM_2_IP=10.30.170.102 ODL_SYSTEM_3_IP=10.30.170.28 TOOLS_SYSTEM_IP= NUM_OPENSTACK_CONTROL_NODES=1 OPENSTACK_CONTROL_NODE_1_IP= NUM_OPENSTACK_COMPUTE_NODES=-1 NUM_OPENSTACK_HAPROXY_NODES=0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'slave_addresses.txt' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins6540877459502347360.sh Preparing for JRE Version 21 Karaf artifact is karaf Karaf project is integration Java home is /usr/lib/jvm/java-21-openjdk-amd64 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'set_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins12424520994150452199.sh 2025-10-12 23:51:46 URL:https://raw.githubusercontent.com/opendaylight/integration-distribution/stable/scandium/pom.xml [2619/2619] -> "pom.xml" [1] Bundle version is 0.21.3-SNAPSHOT --2025-10-12 23:51:47-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/maven-metadata.xml Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1410 (1.4K) [application/xml] Saving to: ‘maven-metadata.xml’ 0K . 100% 55.6M=0s 2025-10-12 23:51:47 (55.6 MB/s) - ‘maven-metadata.xml’ saved [1410/1410] org.opendaylight.integration karaf 0.21.3-SNAPSHOT 20251012.212534 399 20251012212534 pom 0.21.3-20251012.212534-399 20251012212534 tar.gz 0.21.3-20251012.212534-399 20251012212534 zip 0.21.3-20251012.212534-399 20251012212534 cyclonedx xml 0.21.3-20251012.212534-399 20251012212534 cyclonedx json 0.21.3-20251012.212534-399 20251012212534 Nexus timestamp is 0.21.3-20251012.212534-399 Distribution bundle URL is https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip Distribution bundle is karaf-0.21.3-20251012.212534-399.zip Distribution bundle version is 0.21.3-SNAPSHOT Distribution folder is karaf-0.21.3-SNAPSHOT Nexus prefix is https://nexus.opendaylight.org [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'detect_variables.env' [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins15717918054380496199.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: python-heatclient python-openstackclient ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH Copying common-functions.sh to /tmp Copying common-functions.sh to 10.30.171.179:/tmp Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.102:/tmp Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. Copying common-functions.sh to 10.30.170.28:/tmp Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15963947413928083579.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ################################################# ## Configure Cluster and Start ## ################################################# ACTUALFEATURES: odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app SPACE_SEPARATED_FEATURES: odl-integration-compatible-with-all odl-jolokia odl-restconf odl-clustering-test-app Locating script plan to use... script plan exists!!! Changing the script plan path... # Place the scripts in run order: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh Executing /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/scripts/car_people_shard.sh... Add car-people shards file Copy shard config to member-1 with IP address 10.30.171.179 Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. Copy shard config to member-2 with IP address 10.30.170.102 Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. Copy shard config to member-3 with IP address 10.30.170.28 Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. Finished running script plans Configuring member-1 with IP address 10.30.171.179 Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.21.3-SNAPSHOT scandium ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] common-functions.sh is being sourced ++ echo 'common-functions.sh is being sourced' ++ BUNDLEFOLDER=karaf-0.21.3-SNAPSHOT ++ DISTROSTREAM=scandium ++ export MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=akka ++ export AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip --2025-10-12 23:51:59-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 239817985 (229M) [application/zip] Saving to: ‘karaf-0.21.3-20251012.212534-399.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 68.7M 3s 3072K ........ ........ ........ ........ ........ ........ 2% 165M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 121M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 151M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 151M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 155M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 192M 2s 21504K ........ ........ ........ ........ ........ ........ 10% 194M 2s 24576K ........ ........ ........ ........ ........ ........ 11% 198M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 214M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 221M 1s 33792K ........ ........ ........ ........ ........ ........ 15% 164M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 209M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 213M 1s 43008K ........ ........ ........ ........ ........ ........ 19% 215M 1s 46080K ........ ........ ........ ........ ........ ........ 20% 212M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 209M 1s 52224K ........ ........ ........ ........ ........ ........ 23% 213M 1s 55296K ........ ........ ........ ........ ........ ........ 24% 202M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 213M 1s 61440K ........ ........ ........ ........ ........ ........ 27% 208M 1s 64512K ........ ........ ........ ........ ........ ........ 28% 212M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 205M 1s 70656K ........ ........ ........ ........ ........ ........ 31% 209M 1s 73728K ........ ........ ........ ........ ........ ........ 32% 241M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 326M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 299M 1s 82944K ........ ........ ........ ........ ........ ........ 36% 304M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 268M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 325M 1s 92160K ........ ........ ........ ........ ........ ........ 40% 358M 1s 95232K ........ ........ ........ ........ ........ ........ 41% 320M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 316M 1s 101376K ........ ........ ........ ........ ........ ........ 44% 342M 1s 104448K ........ ........ ........ ........ ........ ........ 45% 319M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 278M 1s 110592K ........ ........ ........ ........ ........ ........ 48% 232M 1s 113664K ........ ........ ........ ........ ........ ........ 49% 202M 1s 116736K ........ ........ ........ ........ ........ ........ 51% 233M 1s 119808K ........ ........ ........ ........ ........ ........ 52% 226M 1s 122880K ........ ........ ........ ........ ........ ........ 53% 210M 1s 125952K ........ ........ ........ ........ ........ ........ 55% 190M 0s 129024K ........ ........ ........ ........ ........ ........ 56% 191M 0s 132096K ........ ........ ........ ........ ........ ........ 57% 186M 0s 135168K ........ ........ ........ ........ ........ ........ 59% 191M 0s 138240K ........ ........ ........ ........ ........ ........ 60% 188M 0s 141312K ........ ........ ........ ........ ........ ........ 61% 226M 0s 144384K ........ ........ ........ ........ ........ ........ 62% 243M 0s 147456K ........ ........ ........ ........ ........ ........ 64% 257M 0s 150528K ........ ........ ........ ........ ........ ........ 65% 262M 0s 153600K ........ ........ ........ ........ ........ ........ 66% 259M 0s 156672K ........ ........ ........ ........ ........ ........ 68% 196M 0s 159744K ........ ........ ........ ........ ........ ........ 69% 188M 0s 162816K ........ ........ ........ ........ ........ ........ 70% 191M 0s 165888K ........ ........ ........ ........ ........ ........ 72% 201M 0s 168960K ........ ........ ........ ........ ........ ........ 73% 209M 0s 172032K ........ ........ ........ ........ ........ ........ 74% 210M 0s 175104K ........ ........ ........ ........ ........ ........ 76% 216M 0s 178176K ........ ........ ........ ........ ........ ........ 77% 211M 0s 181248K ........ ........ ........ ........ ........ ........ 78% 215M 0s 184320K ........ ........ ........ ........ ........ ........ 80% 210M 0s 187392K ........ ........ ........ ........ ........ ........ 81% 204M 0s 190464K ........ ........ ........ ........ ........ ........ 82% 214M 0s 193536K ........ ........ ........ ........ ........ ........ 83% 209M 0s 196608K ........ ........ ........ ........ ........ ........ 85% 217M 0s 199680K ........ ........ ........ ........ ........ ........ 86% 204M 0s 202752K ........ ........ ........ ........ ........ ........ 87% 213M 0s 205824K ........ ........ ........ ........ ........ ........ 89% 215M 0s 208896K ........ ........ ........ ........ ........ ........ 90% 208M 0s 211968K ........ ........ ........ ........ ........ ........ 91% 218M 0s 215040K ........ ........ ........ ........ ........ ........ 93% 216M 0s 218112K ........ ........ ........ ........ ........ ........ 94% 222M 0s 221184K ........ ........ ........ ........ ........ ........ 95% 224M 0s 224256K ........ ........ ........ ........ ........ ........ 97% 274M 0s 227328K ........ ........ ........ ........ ........ ........ 98% 270M 0s 230400K ........ ........ ........ ........ ........ ........ 99% 220M 0s 233472K ........ ... 100% 209M=1.1s 2025-10-12 23:52:00 (210 MB/s) - ‘karaf-0.21.3-20251012.212534-399.zip’ saved [239817985/239817985] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.21.3-20251012.212534-399.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.21.3-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/a599b7ba-7bdf-4835-86a4-1de4c4224158.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 75d315e9-0cb0-4b92-bef5-e229c5640df0 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: + unset IFS + echo 'controllerdebugmap: ' cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + '[' -n '' ']' + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 3072m memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=3072m + local -r memconf=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.8" 2025-07-15 OpenJDK Runtime Environment (build 21.0.8+9-Ubuntu-0ubuntu122.04.1) OpenJDK 64-Bit Server VM (build 21.0.8+9-Ubuntu-0ubuntu122.04.1, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java Listing all open ports on controller system... + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found Custom shard config exists!!! + '[' -f /tmp/custom_shard_config.txt ']' + echo 'Custom shard config exists!!!' Copying the shard config... + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.3-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.21.3-SNAPSHOT/bin/configure_cluster.sh 1 10.30.171.179 10.30.170.102 10.30.170.28 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.21.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.171.179" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.179:2550", "akka://opendaylight-cluster-data@10.30.170.102:2550", "akka://opendaylight-cluster-data@10.30.170.28:2550"] roles = ["member-1"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-2 with IP address 10.30.170.102 Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.21.3-SNAPSHOT scandium ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' common-functions.sh is being sourced ++ BUNDLEFOLDER=karaf-0.21.3-SNAPSHOT ++ DISTROSTREAM=scandium ++ export MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=akka ++ export AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip --2025-10-12 23:52:03-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 239817985 (229M) [application/zip] Saving to: ‘karaf-0.21.3-20251012.212534-399.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 95.1M 2s 3072K ........ ........ ........ ........ ........ ........ 2% 142M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 149M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 155M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 179M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 218M 1s 18432K ........ ........ ........ ........ ........ ........ 9% 218M 1s 21504K ........ ........ ........ ........ ........ ........ 10% 143M 1s 24576K ........ ........ ........ ........ ........ ........ 11% 252M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 243M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 254M 1s 33792K ........ ........ ........ ........ ........ ........ 15% 251M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 252M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 251M 1s 43008K ........ ........ ........ ........ ........ ........ 19% 199M 1s 46080K ........ ........ ........ ........ ........ ........ 20% 174M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 137M 1s 52224K ........ ........ ........ ........ ........ ........ 23% 203M 1s 55296K ........ ........ ........ ........ ........ ........ 24% 209M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 201M 1s 61440K ........ ........ ........ ........ ........ ........ 27% 206M 1s 64512K ........ ........ ........ ........ ........ ........ 28% 211M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 215M 1s 70656K ........ ........ ........ ........ ........ ........ 31% 208M 1s 73728K ........ ........ ........ ........ ........ ........ 32% 212M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 214M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 208M 1s 82944K ........ ........ ........ ........ ........ ........ 36% 218M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 222M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 231M 1s 92160K ........ ........ ........ ........ ........ ........ 40% 223M 1s 95232K ........ ........ ........ ........ ........ ........ 41% 237M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 225M 1s 101376K ........ ........ ........ ........ ........ ........ 44% 236M 1s 104448K ........ ........ ........ ........ ........ ........ 45% 239M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 212M 1s 110592K ........ ........ ........ ........ ........ ........ 48% 176M 1s 113664K ........ ........ ........ ........ ........ ........ 49% 173M 1s 116736K ........ ........ ........ ........ ........ ........ 51% 241M 1s 119808K ........ ........ ........ ........ ........ ........ 52% 282M 1s 122880K ........ ........ ........ ........ ........ ........ 53% 268M 1s 125952K ........ ........ ........ ........ ........ ........ 55% 293M 1s 129024K ........ ........ ........ ........ ........ ........ 56% 292M 0s 132096K ........ ........ ........ ........ ........ ........ 57% 279M 0s 135168K ........ ........ ........ ........ ........ ........ 59% 294M 0s 138240K ........ ........ ........ ........ ........ ........ 60% 292M 0s 141312K ........ ........ ........ ........ ........ ........ 61% 283M 0s 144384K ........ ........ ........ ........ ........ ........ 62% 319M 0s 147456K ........ ........ ........ ........ ........ ........ 64% 287M 0s 150528K ........ ........ ........ ........ ........ ........ 65% 298M 0s 153600K ........ ........ ........ ........ ........ ........ 66% 275M 0s 156672K ........ ........ ........ ........ ........ ........ 68% 163M 0s 159744K ........ ........ ........ ........ ........ ........ 69% 355M 0s 162816K ........ ........ ........ ........ ........ ........ 70% 295M 0s 165888K ........ ........ ........ ........ ........ ........ 72% 313M 0s 168960K ........ ........ ........ ........ ........ ........ 73% 314M 0s 172032K ........ ........ ........ ........ ........ ........ 74% 292M 0s 175104K ........ ........ ........ ........ ........ ........ 76% 289M 0s 178176K ........ ........ ........ ........ ........ ........ 77% 295M 0s 181248K ........ ........ ........ ........ ........ ........ 78% 274M 0s 184320K ........ ........ ........ ........ ........ ........ 80% 263M 0s 187392K ........ ........ ........ ........ ........ ........ 81% 201M 0s 190464K ........ ........ ........ ........ ........ ........ 82% 261M 0s 193536K ........ ........ ........ ........ ........ ........ 83% 258M 0s 196608K ........ ........ ........ ........ ........ ........ 85% 251M 0s 199680K ........ ........ ........ ........ ........ ........ 86% 216M 0s 202752K ........ ........ ........ ........ ........ ........ 87% 327M 0s 205824K ........ ........ ........ ........ ........ ........ 89% 310M 0s 208896K ........ ........ ........ ........ ........ ........ 90% 267M 0s 211968K ........ ........ ........ ........ ........ ........ 91% 163M 0s 215040K ........ ........ ........ ........ ........ ........ 93% 226M 0s 218112K ........ ........ ........ ........ ........ ........ 94% 309M 0s 221184K ........ ........ ........ ........ ........ ........ 95% 271M 0s 224256K ........ ........ ........ ........ ........ ........ 97% 284M 0s 227328K ........ ........ ........ ........ ........ ........ 98% 286M 0s 230400K ........ ........ ........ ........ ........ ........ 99% 306M 0s 233472K ........ ... 100% 377M=1.0s 2025-10-12 23:52:04 (227 MB/s) - ‘karaf-0.21.3-20251012.212534-399.zip’ saved [239817985/239817985] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.21.3-20251012.212534-399.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.+ [[ True == \T\r\u\e ]] Configuring the startup features... + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.21.3-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/a599b7ba-7bdf-4835-86a4-1de4c4224158.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 75d315e9-0cb0-4b92-bef5-e229c5640df0 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + logapi=log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' controllerdebugmap: cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=3072m Configure + local -r memconf=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + echo Configure java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 3072m + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' + echo ' max memory: 3072m' memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + echo ' memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java JDK default version ... sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + echo 'JDK default version ...' + java -version openjdk version "21.0.8" 2025-07-15 OpenJDK Runtime Environment (build 21.0.8+9-Ubuntu-0ubuntu122.04.1) OpenJDK 64-Bit Server VM (build 21.0.8+9-Ubuntu-0ubuntu122.04.1, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java Listing all open ports on controller system... + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.3-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.21.3-SNAPSHOT/bin/configure_cluster.sh 2 10.30.171.179 10.30.170.102 10.30.170.28 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.21.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.102" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.179:2550", "akka://opendaylight-cluster-data@10.30.170.102:2550", "akka://opendaylight-cluster-data@10.30.170.28:2550"] roles = ["member-2"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Configuring member-3 with IP address 10.30.170.28 Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + source /tmp/common-functions.sh karaf-0.21.3-SNAPSHOT scandium ++ [[ /tmp/common-functions.sh == \/\t\m\p\/\c\o\n\f\i\g\u\r\a\t\i\o\n\-\s\c\r\i\p\t\.\s\h ]] ++ echo 'common-functions.sh is being sourced' common-functions.sh is being sourced ++ BUNDLEFOLDER=karaf-0.21.3-SNAPSHOT ++ DISTROSTREAM=scandium ++ export MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ MAVENCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ++ export FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ FEATURESCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ++ export CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties ++ CUSTOMPROP=/tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties ++ export LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ LOGCONF=/tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ++ export MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv ++ MEMCONF=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv ++ export CONTROLLERMEM= ++ CONTROLLERMEM= ++ case "${DISTROSTREAM}" in ++ CLUSTER_SYSTEM=akka ++ export AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf ++ AKKACONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf ++ export MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf ++ MODULESCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf ++ export MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf ++ MODULESHARDSCONF=/tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf ++ print_common_env ++ cat common-functions environment: MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv CONTROLLERMEM: AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: ++ SSH='ssh -t -t' ++ extra_services_cntl=' dnsmasq.service httpd.service libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service rabbitmq-server.service ' ++ extra_services_cmp=' libvirtd.service openvswitch.service ovs-vswitchd.service ovsdb-server.service ' Changing to /tmp Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip + echo 'Changing to /tmp' + cd /tmp + echo 'Downloading the distribution from https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip' + wget --progress=dot:mega https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip --2025-10-12 23:52:07-- https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip Resolving nexus.opendaylight.org (nexus.opendaylight.org)... 199.204.45.87, 2604:e100:1:0:f816:3eff:fe45:48d6 Connecting to nexus.opendaylight.org (nexus.opendaylight.org)|199.204.45.87|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 239817985 (229M) [application/zip] Saving to: ‘karaf-0.21.3-20251012.212534-399.zip’ 0K ........ ........ ........ ........ ........ ........ 1% 94.4M 2s 3072K ........ ........ ........ ........ ........ ........ 2% 134M 2s 6144K ........ ........ ........ ........ ........ ........ 3% 138M 2s 9216K ........ ........ ........ ........ ........ ........ 5% 167M 2s 12288K ........ ........ ........ ........ ........ ........ 6% 135M 2s 15360K ........ ........ ........ ........ ........ ........ 7% 178M 2s 18432K ........ ........ ........ ........ ........ ........ 9% 174M 1s 21504K ........ ........ ........ ........ ........ ........ 10% 175M 1s 24576K ........ ........ ........ ........ ........ ........ 11% 187M 1s 27648K ........ ........ ........ ........ ........ ........ 13% 214M 1s 30720K ........ ........ ........ ........ ........ ........ 14% 225M 1s 33792K ........ ........ ........ ........ ........ ........ 15% 267M 1s 36864K ........ ........ ........ ........ ........ ........ 17% 267M 1s 39936K ........ ........ ........ ........ ........ ........ 18% 257M 1s 43008K ........ ........ ........ ........ ........ ........ 19% 271M 1s 46080K ........ ........ ........ ........ ........ ........ 20% 246M 1s 49152K ........ ........ ........ ........ ........ ........ 22% 259M 1s 52224K ........ ........ ........ ........ ........ ........ 23% 255M 1s 55296K ........ ........ ........ ........ ........ ........ 24% 257M 1s 58368K ........ ........ ........ ........ ........ ........ 26% 238M 1s 61440K ........ ........ ........ ........ ........ ........ 27% 234M 1s 64512K ........ ........ ........ ........ ........ ........ 28% 252M 1s 67584K ........ ........ ........ ........ ........ ........ 30% 234M 1s 70656K ........ ........ ........ ........ ........ ........ 31% 208M 1s 73728K ........ ........ ........ ........ ........ ........ 32% 219M 1s 76800K ........ ........ ........ ........ ........ ........ 34% 207M 1s 79872K ........ ........ ........ ........ ........ ........ 35% 214M 1s 82944K ........ ........ ........ ........ ........ ........ 36% 206M 1s 86016K ........ ........ ........ ........ ........ ........ 38% 207M 1s 89088K ........ ........ ........ ........ ........ ........ 39% 253M 1s 92160K ........ ........ ........ ........ ........ ........ 40% 241M 1s 95232K ........ ........ ........ ........ ........ ........ 41% 253M 1s 98304K ........ ........ ........ ........ ........ ........ 43% 245M 1s 101376K ........ ........ ........ ........ ........ ........ 44% 252M 1s 104448K ........ ........ ........ ........ ........ ........ 45% 249M 1s 107520K ........ ........ ........ ........ ........ ........ 47% 257M 1s 110592K ........ ........ ........ ........ ........ ........ 48% 254M 1s 113664K ........ ........ ........ ........ ........ ........ 49% 241M 1s 116736K ........ ........ ........ ........ ........ ........ 51% 272M 1s 119808K ........ ........ ........ ........ ........ ........ 52% 284M 1s 122880K ........ ........ ........ ........ ........ ........ 53% 298M 0s 125952K ........ ........ ........ ........ ........ ........ 55% 285M 0s 129024K ........ ........ ........ ........ ........ ........ 56% 316M 0s 132096K ........ ........ ........ ........ ........ ........ 57% 322M 0s 135168K ........ ........ ........ ........ ........ ........ 59% 261M 0s 138240K ........ ........ ........ ........ ........ ........ 60% 236M 0s 141312K ........ ........ ........ ........ ........ ........ 61% 274M 0s 144384K ........ ........ ........ ........ ........ ........ 62% 222M 0s 147456K ........ ........ ........ ........ ........ ........ 64% 272M 0s 150528K ........ ........ ........ ........ ........ ........ 65% 284M 0s 153600K ........ ........ ........ ........ ........ ........ 66% 248M 0s 156672K ........ ........ ........ ........ ........ ........ 68% 236M 0s 159744K ........ ........ ........ ........ ........ ........ 69% 305M 0s 162816K ........ ........ ........ ........ ........ ........ 70% 300M 0s 165888K ........ ........ ........ ........ ........ ........ 72% 294M 0s 168960K ........ ........ ........ ........ ........ ........ 73% 253M 0s 172032K ........ ........ ........ ........ ........ ........ 74% 335M 0s 175104K ........ ........ ........ ........ ........ ........ 76% 313M 0s 178176K ........ ........ ........ ........ ........ ........ 77% 287M 0s 181248K ........ ........ ........ ........ ........ ........ 78% 294M 0s 184320K ........ ........ ........ ........ ........ ........ 80% 245M 0s 187392K ........ ........ ........ ........ ........ ........ 81% 214M 0s 190464K ........ ........ ........ ........ ........ ........ 82% 237M 0s 193536K ........ ........ ........ ........ ........ ........ 83% 289M 0s 196608K ........ ........ ........ ........ ........ ........ 85% 200M 0s 199680K ........ ........ ........ ........ ........ ........ 86% 248M 0s 202752K ........ ........ ........ ........ ........ ........ 87% 225M 0s 205824K ........ ........ ........ ........ ........ ........ 89% 228M 0s 208896K ........ ........ ........ ........ ........ ........ 90% 201M 0s 211968K ........ ........ ........ ........ ........ ........ 91% 210M 0s 215040K ........ ........ ........ ........ ........ ........ 93% 238M 0s 218112K ........ ........ ........ ........ ........ ........ 94% 225M 0s 221184K ........ ........ ........ ........ ........ ........ 95% 214M 0s 224256K ........ ........ ........ ........ ........ ........ 97% 259M 0s 227328K ........ ........ ........ ........ ........ ........ 98% 208M 0s 230400K ........ ........ ........ ........ ........ ........ 99% 194M 0s 233472K ........ ... 100% 360M=1.0s 2025-10-12 23:52:08 (229 MB/s) - ‘karaf-0.21.3-20251012.212534-399.zip’ saved [239817985/239817985] Extracting the new controller... + echo 'Extracting the new controller...' + unzip -q karaf-0.21.3-20251012.212534-399.zip Adding external repositories... + echo 'Adding external repositories...' + sed -ie 's%org.ops4j.pax.url.mvn.repositories=%org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # If set to true, the following property will not allow any certificate to be used # when accessing Maven repositories through SSL # #org.ops4j.pax.url.mvn.certificateCheck= # # Path to the local Maven settings file. # The repositories defined in this file will be automatically added to the list # of default repositories if the 'org.ops4j.pax.url.mvn.repositories' property # below is not set. # The following locations are checked for the existence of the settings.xml file # * 1. looks for the specified url # * 2. if not found looks for ${user.home}/.m2/settings.xml # * 3. if not found looks for ${maven.home}/conf/settings.xml # * 4. if not found looks for ${M2_HOME}/conf/settings.xml # #org.ops4j.pax.url.mvn.settings= # # Path to the local Maven repository which is used to avoid downloading # artifacts when they already exist locally. # The value of this property will be extracted from the settings.xml file # above, or defaulted to: # System.getProperty( "user.home" ) + "/.m2/repository" # org.ops4j.pax.url.mvn.localRepository=${karaf.home}/${karaf.default.repository} # # Default this to false. It's just weird to use undocumented repos # org.ops4j.pax.url.mvn.useFallbackRepositories=false # # Uncomment if you don't wanna use the proxy settings # from the Maven conf/settings.xml file # # org.ops4j.pax.url.mvn.proxySupport=false # # Comma separated list of repositories scanned when resolving an artifact. # Those repositories will be checked before iterating through the # below list of repositories and even before the local repository # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snaphots # @noreleases : the repository does not contain any released artifacts # # The following property value will add the system folder as a repo. # org.ops4j.pax.url.mvn.defaultRepositories=\ file:${karaf.home}/${karaf.default.repository}@id=system.repository@snapshots,\ file:${karaf.data}/kar@id=kar.repository@multi@snapshots,\ file:${karaf.base}/${karaf.default.repository}@id=child.system.repository@snapshots # Use the default local repo (e.g.~/.m2/repository) as a "remote" repo #org.ops4j.pax.url.mvn.defaultLocalRepoAsRemote=false # # Comma separated list of repositories scanned when resolving an artifact. # The default list includes the following repositories: # http://repo1.maven.org/maven2@id=central # http://repository.springsource.com/maven/bundles/release@id=spring.ebr # http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external # http://zodiac.springsource.com/maven/bundles/release@id=gemini # http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases # https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases # https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases # To add repositories to the default ones, prepend '+' to the list of repositories # to add. # A repository url can be appended with zero or more of the following flags: # @snapshots : the repository contains snapshots # @noreleases : the repository does not contain any released artifacts # @id=repository.id : the id for the repository, just like in the settings.xml this is optional but recommended # org.ops4j.pax.url.mvn.repositories=https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot@id=opendaylight-snapshot@snapshots, https://nexus.opendaylight.org/content/repositories/public@id=opendaylight-mirror, http://repo1.maven.org/maven2@id=central, http://repository.springsource.com/maven/bundles/release@id=spring.ebr.release, http://repository.springsource.com/maven/bundles/external@id=spring.ebr.external, http://zodiac.springsource.com/maven/bundles/release@id=gemini, http://repository.apache.org/content/groups/snapshots-group@id=apache@snapshots@noreleases, https://oss.sonatype.org/content/repositories/snapshots@id=sonatype.snapshots.deploy@snapshots@noreleases, https://oss.sonatype.org/content/repositories/ops4j-snapshots@id=ops4j.sonatype.snapshots.deploy@snapshots@noreleases ### ^^^ No remote repositories. This is the only ODL change compared to Karaf defaults.Configuring the startup features... + [[ True == \T\r\u\e ]] + echo 'Configuring the startup features...' + sed -ie 's/\(featuresBoot=\|featuresBoot =\)/featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app,/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + FEATURE_TEST_STRING=features-test + FEATURE_TEST_VERSION=0.21.3-SNAPSHOT + KARAF_VERSION=karaf4 + [[ integration == \i\n\t\e\g\r\a\t\i\o\n ]] + sed -ie 's%\(featuresRepositories=\|featuresRepositories =\)%featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features,%g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg + [[ ! -z '' ]] + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # # Comma separated list of features repositories to register by default # featuresRepositories = mvn:org.opendaylight.integration/features-test/0.21.3-SNAPSHOT/xml/features,mvn:org.apache.karaf.decanter/apache-karaf-decanter/1.2.0/xml/features, file:${karaf.etc}/a599b7ba-7bdf-4835-86a4-1de4c4224158.xml # # Comma separated list of features to install at startup # featuresBoot = odl-integration-compatible-with-all,odl-jolokia,odl-restconf,odl-clustering-test-app, 75d315e9-0cb0-4b92-bef5-e229c5640df0 # # Resource repositories (OBR) that the features resolver can use # to resolve requirements/capabilities # # The format of the resourceRepositories is # resourceRepositories=[xml:url|json:url],... # for Instance: # #resourceRepositories=xml:http://host/path/to/index.xml # or #resourceRepositories=json:http://host/path/to/index.json # # # Defines if the boot features are started in asynchronous mode (in a dedicated thread) # featuresBootAsynchronous=false # # Service requirements enforcement # # By default, the feature resolver checks the service requirements/capabilities of # bundles for new features (xml schema >= 1.3.0) in order to automatically installs # the required bundles. # The following flag can have those values: # - disable: service requirements are completely ignored # - default: service requirements are ignored for old features # - enforce: service requirements are always verified # #serviceRequirements=default # # Store cfg file for config element in feature # #configCfgStore=true # # Define if the feature service automatically refresh bundles # autoRefresh=true # # Configuration of features processing mechanism (overrides, blacklisting, modification of features) # XML file defines instructions related to features processing # versions.properties may declare properties to resolve placeholders in XML file # both files are relative to ${karaf.etc} # #featureProcessing=org.apache.karaf.features.xml #featureProcessingVersions=versions.properties + configure_karaf_log karaf4 '' + local -r karaf_version=karaf4 + local -r controllerdebugmap= + local logapi=log4j + grep log4j2 /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n log4j2.rootLogger.level = INFO #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 64MB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE + logapi=log4j2 Configuring the karaf log... karaf_version: karaf4, logapi: log4j2 + echo 'Configuring the karaf log... karaf_version: karaf4, logapi: log4j2' + '[' log4j2 == log4j2 ']' + sed -ie 's/log4j2.appender.rolling.policies.size.size = 64MB/log4j2.appender.rolling.policies.size.size = 1GB/g' /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg controllerdebugmap: cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg + orgmodule=org.opendaylight.yangtools.yang.parser.repo.YangTextSchemaContextResolver + orgmodule_=org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN' + echo 'log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN' + unset IFS + echo 'controllerdebugmap: ' + '[' -n '' ']' + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg' + cat /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg ################################################################################ # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ################################################################################ # Common pattern layout for appenders log4j2.pattern = %d{ISO8601} | %-5p | %-16t | %-32c{1} | %X{bundle.id} - %X{bundle.name} - %X{bundle.version} | %m%n # Root logger log4j2.rootLogger.level = INFO # uncomment to use asynchronous loggers, which require mvn:com.lmax/disruptor/3.3.2 library #log4j2.rootLogger.type = asyncRoot #log4j2.rootLogger.includeLocation = false log4j2.rootLogger.appenderRef.RollingFile.ref = RollingFile log4j2.rootLogger.appenderRef.PaxOsgi.ref = PaxOsgi log4j2.rootLogger.appenderRef.Console.ref = Console log4j2.rootLogger.appenderRef.Console.filter.threshold.type = ThresholdFilter log4j2.rootLogger.appenderRef.Console.filter.threshold.level = ${karaf.log.console:-OFF} # Filters for logs marked by org.opendaylight.odlparent.Markers log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.type = ContextMapFilter log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.type = KeyValuePair log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.key = slf4j.marker log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.pair1.value = CONFIDENTIAL log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.operator = or log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMatch = DENY log4j2.rootLogger.appenderRef.RollingFile.filter.confidential.onMismatch = NEUTRAL # Loggers configuration # Spifly logger log4j2.logger.spifly.name = org.apache.aries.spifly log4j2.logger.spifly.level = WARN # Security audit logger log4j2.logger.audit.name = org.apache.karaf.jaas.modules.audit log4j2.logger.audit.level = INFO log4j2.logger.audit.additivity = false log4j2.logger.audit.appenderRef.AuditRollingFile.ref = AuditRollingFile # Appenders configuration # Console appender not used by default (see log4j2.rootLogger.appenderRefs) log4j2.appender.console.type = Console log4j2.appender.console.name = Console log4j2.appender.console.layout.type = PatternLayout log4j2.appender.console.layout.pattern = ${log4j2.pattern} # Rolling file appender log4j2.appender.rolling.type = RollingRandomAccessFile log4j2.appender.rolling.name = RollingFile log4j2.appender.rolling.fileName = ${karaf.data}/log/karaf.log log4j2.appender.rolling.filePattern = ${karaf.data}/log/karaf.log.%i # uncomment to not force a disk flush #log4j2.appender.rolling.immediateFlush = false log4j2.appender.rolling.append = true log4j2.appender.rolling.layout.type = PatternLayout log4j2.appender.rolling.layout.pattern = ${log4j2.pattern} log4j2.appender.rolling.policies.type = Policies log4j2.appender.rolling.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.rolling.policies.size.size = 1GB log4j2.appender.rolling.strategy.type = DefaultRolloverStrategy log4j2.appender.rolling.strategy.max = 7 # Audit file appender log4j2.appender.audit.type = RollingRandomAccessFile log4j2.appender.audit.name = AuditRollingFile log4j2.appender.audit.fileName = ${karaf.data}/security/audit.log log4j2.appender.audit.filePattern = ${karaf.data}/security/audit.log.%i log4j2.appender.audit.append = true log4j2.appender.audit.layout.type = PatternLayout log4j2.appender.audit.layout.pattern = ${log4j2.pattern} log4j2.appender.audit.policies.type = Policies log4j2.appender.audit.policies.size.type = SizeBasedTriggeringPolicy log4j2.appender.audit.policies.size.size = 8MB log4j2.appender.audit.strategy.type = DefaultRolloverStrategy log4j2.appender.audit.strategy.max = 7 # OSGi appender log4j2.appender.osgi.type = PaxOsgi log4j2.appender.osgi.name = PaxOsgi log4j2.appender.osgi.filter = * # help with identification of maven-related problems with pax-url-aether #log4j2.logger.aether.name = shaded.org.eclipse.aether #log4j2.logger.aether.level = TRACE #log4j2.logger.http-headers.name = shaded.org.apache.http.headers #log4j2.logger.http-headers.level = DEBUG #log4j2.logger.maven.name = org.ops4j.pax.url.mvn #log4j2.logger.maven.level = TRACE log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.name = WARN log4j2.logger.org_opendaylight_yangtools_yang_parser_repo_YangTextSchemaContextResolver.level = WARN + set_java_vars /usr/lib/jvm/java-21-openjdk-amd64 3072m /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + local -r java_home=/usr/lib/jvm/java-21-openjdk-amd64 + local -r controllermem=3072m Configure + local -r memconf=/tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + echo Configure + echo ' java home: /usr/lib/jvm/java-21-openjdk-amd64' java home: /usr/lib/jvm/java-21-openjdk-amd64 max memory: 3072m memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + echo ' max memory: 3072m' + echo ' memconf: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv' + sed -ie 's%^# export JAVA_HOME%export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}%g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + sed -ie 's/JAVA_MAX_MEM="2048m"/JAVA_MAX_MEM=3072m/g' /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv + echo 'cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv' + cat /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv #!/bin/sh # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # # # handle specific scripts; the SCRIPT_NAME is exactly the name of the Karaf # script: client, instance, shell, start, status, stop, karaf # # if [ "${KARAF_SCRIPT}" == "SCRIPT_NAME" ]; then # Actions go here... # fi # # general settings which should be applied for all scripts go here; please keep # in mind that it is possible that scripts might be executed more than once, e.g. # in example of the start script where the start script is executed first and the # karaf script afterwards. # # # The following section shows the possible configuration options for the default # karaf scripts # export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64} # Location of Java installation # export JAVA_OPTS # Generic JVM options, for instance, where you can pass the memory configuration # export JAVA_NON_DEBUG_OPTS # Additional non-debug JVM options # export EXTRA_JAVA_OPTS # Additional JVM options # export KARAF_HOME # Karaf home folder # export KARAF_DATA # Karaf data folder # export KARAF_BASE # Karaf base folder # export KARAF_ETC # Karaf etc folder # export KARAF_LOG # Karaf log folder # export KARAF_SYSTEM_OPTS # First citizen Karaf options # export KARAF_OPTS # Additional available Karaf options # export KARAF_DEBUG # Enable debug mode # export KARAF_REDIRECT # Enable/set the std/err redirection when using bin/start # export KARAF_NOROOT # Prevent execution as root if set to true Set Java version + echo 'Set Java version' + sudo /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/java-21-openjdk-amd64/bin/java 1 sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required + sudo /usr/sbin/alternatives --set java /usr/lib/jvm/java-21-openjdk-amd64/bin/java sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper sudo: a password is required JDK default version ... + echo 'JDK default version ...' + java -version openjdk version "21.0.8" 2025-07-15 OpenJDK Runtime Environment (build 21.0.8+9-Ubuntu-0ubuntu122.04.1) OpenJDK 64-Bit Server VM (build 21.0.8+9-Ubuntu-0ubuntu122.04.1, mixed mode, sharing) Set JAVA_HOME + echo 'Set JAVA_HOME' + export JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 + JAVA_HOME=/usr/lib/jvm/java-21-openjdk-amd64 ++ readlink -e /usr/lib/jvm/java-21-openjdk-amd64/bin/java Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java + JAVA_RESOLVED=/usr/lib/jvm/java-21-openjdk-amd64/bin/java + echo 'Java binary pointed at by JAVA_HOME: /usr/lib/jvm/java-21-openjdk-amd64/bin/java' Listing all open ports on controller system... + echo 'Listing all open ports on controller system...' + netstat -pnatu /tmp/configuration-script.sh: line 40: netstat: command not found + '[' -f /tmp/custom_shard_config.txt ']' Custom shard config exists!!! Copying the shard config... + echo 'Custom shard config exists!!!' + echo 'Copying the shard config...' + cp /tmp/custom_shard_config.txt /tmp/karaf-0.21.3-SNAPSHOT/bin/ Configuring cluster + echo 'Configuring cluster' + /tmp/karaf-0.21.3-SNAPSHOT/bin/configure_cluster.sh 3 10.30.171.179 10.30.170.102 10.30.170.28 ################################################ ## Configure Cluster ## ################################################ NOTE: Cluster configuration files not found. Copying from /tmp/karaf-0.21.3-SNAPSHOT/system/org/opendaylight/controller/sal-clustering-config/10.0.14 Configuring unique name in akka.conf Configuring hostname in akka.conf Configuring data and rpc seed nodes in akka.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Configuring replication type in module-shards.conf ################################################ ## NOTE: Manually restart controller to ## ## apply configuration. ## ################################################ Dump akka.conf + echo 'Dump akka.conf' + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf odl-cluster-data { akka { remote { artery { enabled = on transport = tcp canonical.hostname = "10.30.170.28" canonical.port = 2550 } } cluster { # Using artery. seed-nodes = ["akka://opendaylight-cluster-data@10.30.171.179:2550", "akka://opendaylight-cluster-data@10.30.170.102:2550", "akka://opendaylight-cluster-data@10.30.170.28:2550"] roles = ["member-3"] # when under load we might trip a false positive on the failure detector # failure-detector { # heartbeat-interval = 4 s # acceptable-heartbeat-pause = 16s # } } persistence { # By default the snapshots/journal directories live in KARAF_HOME. You can choose to put it somewhere else by # modifying the following two properties. The directory location specified may be a relative or absolute path. # The relative path is always relative to KARAF_HOME. # snapshot-store.local.dir = "target/snapshots" # Use lz4 compression for LocalSnapshotStore snapshots snapshot-store.local.use-lz4-compression = false # Size of blocks for lz4 compression: 64KB, 256KB, 1MB or 4MB snapshot-store.local.lz4-blocksize = 256KB } disable-default-actor-system-quarantined-event-handling = "false" } } Dump modules.conf + echo 'Dump modules.conf' + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf modules = [ { name = "inventory" namespace = "urn:opendaylight:inventory" shard-strategy = "module" }, { name = "topology" namespace = "urn:TBD:params:xml:ns:yang:network-topology" shard-strategy = "module" }, { name = "toaster" namespace = "http://netconfcentral.org/ns/toaster" shard-strategy = "module" }, { name = "car" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car" shard-strategy = "module" }, { name = "people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:people" shard-strategy = "module" }, { name = "car-people" namespace = "urn:opendaylight:params:xml:ns:yang:controller:config:sal-clustering-it:car-people" shard-strategy = "module" } ] Dump module-shards.conf + echo 'Dump module-shards.conf' + cat /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf module-shards = [ { name = "default" shards = [ { name = "default" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "inventory" shards = [ { name="inventory" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "topology" shards = [ { name="topology" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "toaster" shards = [ { name="toaster" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car" shards = [ { name="car" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "people" shards = [ { name="people" replicas = ["member-1", "member-2", "member-3"] } ] }, { name = "car-people" shards = [ { name="car-people" replicas = ["member-1", "member-2", "member-3"] } ] } ] Locating config plan to use... Finished running config plans Starting member-1 with IP address 10.30.171.179 Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log Starting member-2 with IP address 10.30.170.102 Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log Starting member-3 with IP address 10.30.170.28 Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. Redirecting karaf console output to karaf_console.log Starting controller... start: Redirecting Karaf output to /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins17681813171572909700.sh common-functions.sh is being sourced common-functions environment: MAVENCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.url.mvn.cfg ACTUALFEATURES: FEATURESCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.apache.karaf.features.cfg CUSTOMPROP: /tmp/karaf-0.21.3-SNAPSHOT/etc/custom.properties LOGCONF: /tmp/karaf-0.21.3-SNAPSHOT/etc/org.ops4j.pax.logging.cfg MEMCONF: /tmp/karaf-0.21.3-SNAPSHOT/bin/setenv CONTROLLERMEM: 2048m AKKACONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/akka.conf MODULESCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/modules.conf MODULESHARDSCONF: /tmp/karaf-0.21.3-SNAPSHOT/configuration/initial/module-shards.conf SUITES: + echo '#################################################' ################################################# + echo '## Verify Cluster is UP ##' ## Verify Cluster is UP ## + echo '#################################################' ################################################# + create_post_startup_script + cat + copy_and_run_post_startup_script + seed_index=1 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Execute the post startup script on controller 10.30.171.179' Execute the post startup script on controller 10.30.171.179 + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.171.179:/tmp/ Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + ssh 10.30.171.179 'bash /tmp/post-startup-script.sh 1' Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2025-10-12T23:52:56,679 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2025-10-12T23:52:56,679 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 1 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Execute the post startup script on controller 10.30.170.102' Execute the post startup script on controller 10.30.170.102 + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.102:/tmp/ Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + ssh 10.30.170.102 'bash /tmp/post-startup-script.sh 2' Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2025-10-12T23:52:56,827 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2025-10-12T23:52:56,827 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 2 == 0 ']' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Execute the post startup script on controller 10.30.170.28' Execute the post startup script on controller 10.30.170.28 + scp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/post-startup-script.sh 10.30.170.28:/tmp/ Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + ssh 10.30.170.28 'bash /tmp/post-startup-script.sh 3' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found /tmp/post-startup-script.sh: line 4: netstat: command not found Waiting up to 3 minutes for controller to come up, checking every 5 seconds... 2025-10-12T23:52:56,205 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Controller is UP 2025-10-12T23:52:56,205 | INFO | SystemReadyService-0 | SimpleSystemReadyMonitor | 282 - org.opendaylight.infrautils.ready-api - 7.1.7 | System ready; AKA: Aye captain, all warp coils are now operating at peak efficiency! [M.] Listing all open ports on controller system... /tmp/post-startup-script.sh: line 51: netstat: command not found looking for "BindException: Address already in use" in log file looking for "server is unhealthy" in log file + '[' 0 == 0 ']' + seed_index=1 + dump_controller_threads ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.171.179 'sudo ps aux' Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=2103 + echo 'karaf main: org.apache.karaf.main.Main, pid:2103' karaf main: org.apache.karaf.main.Main, pid:2103 + ssh 10.30.171.179 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2103' Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.102 'sudo ps aux' Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=2084 + echo 'karaf main: org.apache.karaf.main.Main, pid:2084' karaf main: org.apache.karaf.main.Main, pid:2084 + ssh 10.30.170.102 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2084' Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump' Let's take the karaf thread dump + ssh 10.30.170.28 'sudo ps aux' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_before.log ++ grep -v grep ++ cut -f2 '-d ' ++ tr -s ' ' + pid=2089 + echo 'karaf main: org.apache.karaf.main.Main, pid:2089' karaf main: org.apache.karaf.main.Main, pid:2089 + ssh 10.30.170.28 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2089' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + '[' 0 -gt 0 ']' + echo 'Generating controller variables...' Generating controller variables... ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.179' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.179 -v ODL_SYSTEM_2_IP:10.30.170.102' + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + odl_variables=' -v ODL_SYSTEM_1_IP:10.30.171.179 -v ODL_SYSTEM_2_IP:10.30.170.102 -v ODL_SYSTEM_3_IP:10.30.170.28' + echo 'Generating mininet variables...' Generating mininet variables... ++ seq 1 0 + get_test_suites SUITES + local __suite_list=SUITES + echo 'Locating test plan to use...' Locating test plan to use... + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt + '[' '!' -f /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell-scandium.txt ']' + testplan_filepath=/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt + '[' disabled '!=' disabled ']' + echo 'Changing the testplan path...' Changing the testplan path... + sed s:integration:/w/workspace/controller-csit-3node-clustering-tell-all-scandium: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/testplans/controller-clustering-tell.txt + cat testplan.txt # Place the suites in run order: # disabling all "prefix based" suites. This functionality was newly # introduced with these tests in 2017. The assumption is that # development stopped in that area, but may continue at a later # time. Still, the tests are failing and no resources to solve the # failures at this time. If/When this changes, we can uncomment # those suites. Note that every suite is commented out with it's # accompanying "restart_with_tell_based_true" setup suite. # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-prefix-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot # /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability_prefbasedshard.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot + '[' -z '' ']' ++ grep -E -v '(^[[:space:]]*#|^[[:space:]]*$)' testplan.txt ++ tr '\012' ' ' + suite_list='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + eval 'SUITES='\''/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot '\''' ++ SUITES='/w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ' + echo 'Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ...' Starting Robot test suites /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ... + robot -N controller-clustering-tell.txt --removekeywords wuks -e exclude -e skip_if_scandium -v BUNDLEFOLDER:karaf-0.21.3-SNAPSHOT -v BUNDLE_URL:https://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/org/opendaylight/integration/karaf/0.21.3-SNAPSHOT/karaf-0.21.3-20251012.212534-399.zip -v CONTROLLER:10.30.171.179 -v CONTROLLER1:10.30.170.102 -v CONTROLLER2:10.30.170.28 -v CONTROLLER_USER:jenkins -v JAVA_HOME:/usr/lib/jvm/java-21-openjdk-amd64 -v JDKVERSION:openjdk21 -v JENKINS_WORKSPACE:/w/workspace/controller-csit-3node-clustering-tell-all-scandium -v MININET: -v MININET1: -v MININET2: -v MININET_USER:jenkins -v NEXUSURL_PREFIX:https://nexus.opendaylight.org -v NUM_ODL_SYSTEM:3 -v NUM_TOOLS_SYSTEM:0 -v ODL_STREAM:scandium -v ODL_SYSTEM_IP:10.30.171.179 -v ODL_SYSTEM_1_IP:10.30.171.179 -v ODL_SYSTEM_2_IP:10.30.170.102 -v ODL_SYSTEM_3_IP:10.30.170.28 -v ODL_SYSTEM_USER:jenkins -v TOOLS_SYSTEM_IP: -v TOOLS_SYSTEM_USER:jenkins -v USER_HOME:/home/jenkins -v IS_KARAF_APPL:True -v WORKSPACE:/tmp /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/ddb-sanity-module-based.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/clean_leader_shutdown.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/explicit_leader_movement.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/leader_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/client_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/listener_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/master_stability.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_true.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot /w/workspace/controller-csit-3node-clustering-tell-all-scandium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot ============================================================================== controller-clustering-tell.txt ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataBroker tes... ============================================================================== Get_Shard_Role :: Get shard role. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_get_shard_role&order=bug_status" HTTPError: 404 Client Error: Not Found for url: http://10.30.171.179:8181/restconf/operations/cluster-admin:get-shard-role ------------------------------------------------------------------------------ Subscribe_Listener_To_Leader :: Subscribe listener to leader. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Subscribe_Listener_To_Follower :: Subscribe listener to follower. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_subscribe_listener_to_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Make_Leader_Local :: Make the loeader local and verify. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_make_leader_local&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Leader_Shard_Replica_And_Add_It_Back :: Remove and add shar... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_leader_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Remove_Follower_Shard_Replica_And_Add_It_Back :: Remove and add sh... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_remove_follower_shard_replica_and_add_it_back&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Leader :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_leader&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_One_Node_Follower :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_one_node_follower&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Write_Transactions_All_Nodes :: Write transactions. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_ddb_sanity_module_based_write_transactions_all_nodes&order=bug_status" Resolving variable '${response.text}' failed: AttributeError: 'ReadTimeout' object has no attribute 'text' ------------------------------------------------------------------------------ controller-clustering-tell.txt.Ddb-Sanity-Module-Based :: DOMDataB... | FAIL | 9 tests, 0 passed, 9 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBroker testi... ============================================================================== Local_Leader_Shutdown :: Shutdown the leader on the same node as t... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_local_leader_shutdown&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_Leader_Shutdown :: Shutdown the leader on different node as... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_clean_leader_shutdown_remote_leader_shutdown&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.179', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Clean Leader Shutdown :: DOMDataBro... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Explicit Leader Movement :: DOMDataBroker te... ============================================================================== Local_To_Remote_Movement :: Leader moves from local to remote node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_local_to_remote_movement&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Remote_Movement :: Leader moves from one remote to other... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_remote_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.179', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart2 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_restart2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_restart2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Remote_To_Local_Movement :: Leader moves from remote to local node... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_explicit_leader_movement_remote_to_local_movement&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.179', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Explicit Leader Movement :: DOMData... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker testing: L... ============================================================================== Healing_Within_Request_Timeout :: The isolated node (leader) is re... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_within_request_timeout&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Restart :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_restart" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_restart&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Healing_After_Request_Timeout :: The isolated node (leader) is rej... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_leader_isolation_healing_after_request_timeout&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.179', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Leader Isolation :: DOMDataBroker t... | FAIL | 3 tests, 0 passed, 3 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Client Isolation :: DOMDataBroker testing: C... ============================================================================== Producer_On_Shard_Leader_Node_ChainedTx :: Client isolation with p... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_chainedtx&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) 2) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 3) Resolving variable '${response.status_code}' failed: AttributeError: 'No... [ Message content over the limit has been removed. ] 65) Resolving variable '${response.text}' failed: AttributeError: 'NoneType' object has no attribute 'text' 66) Evaluating expression "json.loads('''None''')" failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) 67) TypeError: Expected argument 1 to be a dictionary, got None instead. 68) TypeError: Expected argument 1 to be a dictionary, got None instead. 69) Unrecognized Raft state: None 70) No leader found. 71) Too many Leaders. 72) IndexError: Given index 0 is out of the range 0--1. 4) KeyError: 'threads' ------------------------------------------------------------------------------ Restart1 :: Restart odl | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_restart1" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_restart1&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Producer_On_Shard_Leader_Node_SimpleTx :: Client isolation with pr... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_client_isolation_producer_on_shard_leader_node_simpletx&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.179', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.171.179', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.171.179', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Also keyword teardown failed: Several failures occurred: 1) Variable '${client_node_dst}' not found. 2) Variable '${client_node_dst}' not found. 3) Keyword 'ShardStability.Shards_Stability_Get_Details' failed after retrying for 1 minute 10 seconds. The last error was: Several failures occurred: 1) ConnectionError: HTTPConnectionPool(host='10.30.171.179', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ Restart_2 :: Restart odl. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_restart_2" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_restart_2&order=bug_status" Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Move_Leader_From_Listener_Remote_To_Local :: Listener runs on foll... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_listener_stability_move_leader_from_listener_remote_to_local&order=bug_status" ConnectionError: HTTPConnectionPool(host='10.30.171.179', port=8181): Max retries exceeded with url: /jolokia/read/org.opendaylight.controller:Category=Shards,name=member-1-shard-default-config,type=DistributedConfigDatastore (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Listener Stability :: DOMDataBroker... | FAIL | 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Master Stability :: Cluster Singleton testin... ============================================================================== Register_Singleton_Constant_On_Each_Node_And_Verify :: Register a ... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_register_singleton_constant_on_each_node_and_verify&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Non_Master_Node :: Unregister the... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_non_master_node&order=bug_status" Variable '@{cs_candidates}' not found. Did you mean: @{cs_exp_candidates} ------------------------------------------------------------------------------ Monitor_Stability_While_Unregistered :: Verify that the owner rema... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_monitor_stability_while_unregistered&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Reregister_Singleton_Constant :: Re-register the unregistered cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_reregister_singleton_constant" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_reregister_singleton_constant&order=bug_status" Variable '${unregistered_node}' not found. ------------------------------------------------------------------------------ Verify_Stability_After_Reregistration :: Verify that the owner rem... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_verify_stability_after_reregistration&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_master_stability_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Master Stability :: Cluster Singlet... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Partition And Heal :: Cluster Singleton test... ============================================================================== Register_Singleton_Constant_On_Each_Node :: Register a candidate a... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_register_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ Verify_Singleton_Constant_On_Each_Node :: Store the owner and cand... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_verify_singleton_constant_on_each_node&order=bug_status" Could not parse owner and candidates for device get-singleton-constant-service'] ------------------------------------------------------------------------------ Isolate_Owner_Node :: Isolate the cluster node which is the owner.... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_isolate_owner_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_isolate_owner_node&order=bug_status" Variable '${cs_owner}' not found. ------------------------------------------------------------------------------ Monitor_Stability_While_Isolated :: Monitor the stability of the s... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_monitor_stability_while_isolated&order=bug_status" Invalid IF condition: Evaluating expression '"${index}" == "${cs_isolated_index}"' failed: Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Rejoin_Isolated_node :: Rejoin isolated node. | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_rejoin_isolated_node&order=bug_status" Variable '${cs_isolated_index}' not found. ------------------------------------------------------------------------------ Unregister_Singleton_Constant_On_Each_Node :: Unregister the appli... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_partition_and_heal_unregister_singleton_constant_on_each_node&order=bug_status" ReadTimeout: HTTPConnectionPool(host='10.30.170.28', port=8181): Read timed out. (read timeout=125.0) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Partition And Heal :: Cluster Singl... | FAIL | 6 tests, 0 passed, 6 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Chasing The Leader :: Cluster Singleton test... ============================================================================== Register_Candidates :: Register a candidate application on each no... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_register_candidates" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_register_candidates&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/operations/odl-mdsal-lowlevel-control:register-flapping-singleton ------------------------------------------------------------------------------ Do_Nothing :: Do nothing for the time of the test duration, becaus... | PASS | ------------------------------------------------------------------------------ Unregister_Candidates_And_Validate_Criteria :: Unregister the test... | FAIL | ... click for list of related bugs or create a new one if needed (with the "controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria" reference somewhere inside) "https://bugs.opendaylight.org/buglist.cgi?f1=cf_external_ref&o1=substring&v1=controller_clustering_tell_txt_chasing_the_leader_unregister_candidates_and_validate_criteria&order=bug_status" HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/operations/odl-mdsal-lowlevel-control:unregister-flapping-singleton ------------------------------------------------------------------------------ controller-clustering-tell.txt.Chasing The Leader :: Cluster Singl... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Restart Odl With Tell Based True :: Set tell... ============================================================================== Stop_All_Members :: Stop every odl node. | FAIL | Keyword 'Verify_Karaf_Is_Not_Running_On_Member' failed after retrying for 6 minutes. The last error was: Found running Karaf count: 1: 0 != 1 ------------------------------------------------------------------------------ Set_Tell_Based_Protocol_Usage :: Un-comment the flag usage in conf... | PASS | ------------------------------------------------------------------------------ Start_All_And_Sync :: Start each member and wait for sync. | FAIL | Keyword 'Verify_Members_Are_Ready' failed after retrying for 6 minutes. The last error was: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/jolokia/read/org.opendaylight.controller:Category=ShardManager,name=shard-manager-config,type=DistributedConfigDatastore ------------------------------------------------------------------------------ controller-clustering-tell.txt.Restart Odl With Tell Based True ::... | FAIL | 3 tests, 1 passed, 2 failed ============================================================================== controller-clustering-tell.txt.Carpeople Crud :: Suite for performing basic... ============================================================================== Add_Cars_To_Leader :: Add 30 cars to car Leader by one big PUT. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Leader :: GET response from Leader should match ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower :: Add 30 people to people first Foll... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Leader :: GET response from Leader should matc... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_People_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader :: Buy some cars on car-people Leader, loop of ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Followers :: On each Follower buy corresponding ID seg... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Leader :: GET car-person mappings from Lead... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Added_CarPeople_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople_On_Leader :: DELETE car-people container. No ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People_On_Leader :: DELETE people container. No verific... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars_On_Leader :: DELETE cars container. No verificatio... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Carpeople Crud :: Suite for perform... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 13 tests, 0 passed, 13 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud :: Suite mixing basic oper... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_Original_Car_Leader :: Stop the car Leader to cause a new lea... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Old_Car_Leader :: Start the stopped member without deleting ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud :: Suite mixing b... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Persistence Recovery :: This test restar... ============================================================================== Add_Cars_On_Leader_And_Verify :: Single big PUT to datastore to ad... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Stop_All_Members :: Stop all controllers. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_All_Members :: Start all controllers (should restore the per... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Memorize_Leader_And_Followers :: Locate current Leader of car Shard. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Leader :: GET cars from Leader, should match the PUT d... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Followers :: The same check on other members. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Persistence Recovery :: This te... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 7 tests, 0 passed, 7 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover :: This test focuses on test... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Reboot_People_Leader :: Previous people Leader is rebooted. We sho... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Reboot_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Reboot_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover :: This test focuse... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Entity Isolate :: Suite for performing membe... ============================================================================== Check All Shards Before Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Isolate Entity Leader :: Isolate the entity-ownership Leader to ca... | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Check All Shards After Isolate :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Rejoin Entity Leader :: Rejoin the entity-ownership Leader. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ Check All Shards After Rejoin :: Check all shards in controller. | FAIL | Parent suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) ------------------------------------------------------------------------------ controller-clustering-tell.txt.Entity Isolate :: Suite for perform... | FAIL | Suite setup failed: Evaluating expression 'json.loads(\'\'\'{\n "error": "javax.management.InstanceNotFoundException : org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "error_type": "javax.management.InstanceNotFoundException",\n "request": {\n "mbean": "org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore",\n "type": "read"\n },\n "stacktrace": "javax.management.InstanceNotFoundException: org.opendaylight.controller:Category=Shards,name=member-1-shard-entity-ownership-operational,type=DistributedOperationalDatastore\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1073)\\n\\tat java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1343)\\n\\tat java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:921)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:46)\\n\\tat org.jolokia.handler.ReadHandler$1.execute(ReadHandler.java:41)\\n\\tat org.jolokia.backend.executor.AbstractMBeanServerExecutor.call(AbstractMBeanServerExecutor.java:90)\\n\\tat org.jolokia.handler.ReadHandler.getMBeanInfo(ReadHandler.java:233)\\n\\tat org.jolokia.handler.ReadHandler.getAllAttributesNames(ReadHandler.java:245)\\n\\tat org.jolokia.handler.ReadHandler.resolveAttributes(ReadHandler.java:221)\\n\\tat org.jolokia.handler.ReadHandler.f... [ Message content over the limit has been removed. ] ...lipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\\n\\tat org.eclipse.jetty.server.Server.handle(Server.java:516)\\n\\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)\\n\\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)\\n\\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)\\n\\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\\n\\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\\n\\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\\n\\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)\\n\\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)\\n\\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\\n\\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n",\n "status": 404\n}\n\'\'\')' failed: JSONDecodeError: Invalid control character at: line 8 column 190 (char 619) 5 tests, 0 passed, 5 failed ============================================================================== controller-clustering-tell.txt.Buycar Failover Isolation :: This test focus... ============================================================================== Add_Cars_To_Leader_And_Verify :: Add all needed cars to car Leader... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_People_To_First_Follower_And_Verify :: Add all needed people t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_And_Verify :: Buy some cars on the leader member. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_And_Verify :: Buy some cars on the first foll... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_and_Rejoin_People_Leader :: Previous people Leader is isol... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Leader_After_Rejoin_And_Verify :: Buy some cars on the... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Buy_Cars_On_Follower_After_Rejoin_And_Verify :: Buy some cars on t... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_CarPeople :: DELETE car-people container. No verificati... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_People :: DELETE people container. No verification beyo... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_All_Cars :: DELETE cars container. No verification beyond h... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Buycar Failover Isolation :: This t... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 10 tests, 0 passed, 10 failed ============================================================================== controller-clustering-tell.txt.Car Failover Crud Isolation :: Suite mixing ... ============================================================================== Add_Original_Cars_On_Old_Leader_And_Verify :: Add initial cars on ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Isolate_Original_Car_Leader :: Isolate the car Leader to cause a n... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Wait_For_New_Leader :: Wait until new car Leader is elected. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Leader :: GET cars from new Leader, shoul... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Original_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Original_Cars_On_New_Leader :: Delete cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Leader_Cars_On_New_Leader :: Add cars on the new Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Leader :: GET cars from new Leader, should ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Leader_Cars_On_New_Followers :: The same check on other existi... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Leader_Cars_On_New_First_Follower :: Delete cars in new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Follower_Cars_On_New_First_Follower :: Add cars on the new fir... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_New_Leader :: Get cars from the new Leader, sh... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Follower_Cars_On_New_Followers :: The same check on other exis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Rejoin_Old_Car_Leader :: Rejoin the isolated member without deleti... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Folower_Cars_On_Old_Leader :: GET cars from the restarted memb... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Follower_Cars_On_New_Leader :: Delete cars on the last Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Failover Crud Isolation :: Suit... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 16 tests, 0 passed, 16 failed ============================================================================== controller-clustering-tell.txt.Car Outage Corners :: Cluster suite for test... ============================================================================== Stop_Majority_Of_The_Followers :: Stop half plus one car Follower ... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Attempt_To_Add_Cars_To_Leader :: Adding cars should fail, as major... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Tipping_Follower :: Start one Follower member without persis... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Add_Cars_On_Tipping_Follower :: Add cars on the tipping Follower. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_Existing_Members :: On each up member: GET cars, shoul... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Start_Other_Followers :: Start other followers without persisted d... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ See_Cars_On_New_Follower_Leader :: GET cars from a new follower to... | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ Delete_Cars_On_Leader :: Delete cars on Leader. | FAIL | Parent suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig ------------------------------------------------------------------------------ controller-clustering-tell.txt.Car Outage Corners :: Cluster suite... | FAIL | Suite setup failed: HTTPError: 401 Client Error: Unauthorized for url: http://10.30.170.102:8181/rests/data/ietf-yang-library:modules-state?content=nonconfig 8 tests, 0 passed, 8 failed ============================================================================== controller-clustering-tell.txt | FAIL | 162 tests, 11 passed, 151 failed ============================================================================== Output: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/output.xml Log: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/log.html Report: /w/workspace/controller-csit-3node-clustering-tell-all-scandium/report.html + true + echo 'Examining the files in data/log and checking filesize' Examining the files in data/log and checking filesize + ssh 10.30.171.179 'ls -altr /tmp/karaf-0.21.3-SNAPSHOT/data/log/' Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. total 7908 drwxrwxr-x 2 jenkins jenkins 4096 Oct 12 23:52 . -rw-rw-r-- 1 jenkins jenkins 1720 Oct 12 23:52 karaf_console.log drwxrwxr-x 9 jenkins jenkins 4096 Oct 13 05:23 .. -rw-rw-r-- 1 jenkins jenkins 8077344 Oct 13 05:35 karaf.log + ssh 10.30.171.179 'du -hs /tmp/karaf-0.21.3-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. 7.8M /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.170.102 'ls -altr /tmp/karaf-0.21.3-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. total 28432 drwxrwxr-x 2 jenkins jenkins 4096 Oct 12 23:52 . -rw-rw-r-- 1 jenkins jenkins 1720 Oct 12 23:52 karaf_console.log drwxrwxr-x 4 jenkins jenkins 4096 Oct 13 05:23 .. -rw-rw-r-- 1 jenkins jenkins 29095029 Oct 13 05:36 karaf.log + ssh 10.30.170.102 'du -hs /tmp/karaf-0.21.3-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. 28M /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log 4.0K /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log + ssh 10.30.170.28 'ls -altr /tmp/karaf-0.21.3-SNAPSHOT/data/log/' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. total 11308 drwxrwxr-x 2 jenkins jenkins 4096 Oct 12 23:52 . -rw-rw-r-- 1 jenkins jenkins 175337 Oct 13 00:46 karaf_console.log drwxrwxr-x 4 jenkins jenkins 4096 Oct 13 05:23 .. -rw-rw-r-- 1 jenkins jenkins 11386928 Oct 13 05:36 karaf.log + ssh 10.30.170.28 'du -hs /tmp/karaf-0.21.3-SNAPSHOT/data/log/*' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. 11M /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log 172K /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log + set +e ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.171.179 'sudo ps aux' Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log ++ cut -f2 '-d ' ++ grep -v grep + pid=29703 + echo 'karaf main: org.apache.karaf.main.Main, pid:29703' karaf main: org.apache.karaf.main.Main, pid:29703 + ssh 10.30.171.179 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 29703' Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.171.179 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.102 'sudo ps aux' Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log ++ grep -v grep ++ tr -s ' ' ++ cut -f2 '-d ' + pid=24231 + echo 'karaf main: org.apache.karaf.main.Main, pid:24231' karaf main: org.apache.karaf.main.Main, pid:24231 + ssh 10.30.170.102 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 24231' Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.102 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Let'\''s take the karaf thread dump again' Let's take the karaf thread dump again + ssh 10.30.170.28 'sudo ps aux' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. ++ tr -s ' ' ++ grep org.apache.karaf.main.Main /w/workspace/controller-csit-3node-clustering-tell-all-scandium/ps_after.log ++ cut -f2 '-d ' ++ grep -v grep + pid=2089 + echo 'karaf main: org.apache.karaf.main.Main, pid:2089' karaf main: org.apache.karaf.main.Main, pid:2089 + ssh 10.30.170.28 '/usr/lib/jvm/java-21-openjdk-amd64/bin/jstack -l 2089' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + echo 'killing karaf process...' killing karaf process... + ssh 10.30.170.28 bash -c 'ps axf | grep karaf | grep -v grep | awk '\''{print "kill -9 " $1}'\'' | sh' Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + sleep 5 ++ seq 1 3 + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_1_IP + echo 'Compressing karaf.log 1' Compressing karaf.log 1 + ssh 10.30.171.179 gzip --best /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 1' Fetching compressed karaf.log 1 + scp 10.30.171.179:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz odl1_karaf.log.gz Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + ssh 10.30.171.179 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + scp 10.30.171.179:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log odl1_karaf_console.log Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + ssh 10.30.171.179 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-1 + scp '10.30.171.179:/tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log' gclogs-1/ Warning: Permanently added '10.30.171.179' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_2_IP + echo 'Compressing karaf.log 2' Compressing karaf.log 2 + ssh 10.30.170.102 gzip --best /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 2' Fetching compressed karaf.log 2 + scp 10.30.170.102:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz odl2_karaf.log.gz Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + ssh 10.30.170.102 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + scp 10.30.170.102:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log odl2_karaf_console.log Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + ssh 10.30.170.102 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-2 + scp '10.30.170.102:/tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log' gclogs-2/ Warning: Permanently added '10.30.170.102' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log: No such file or directory + for i in $(seq 1 "${NUM_ODL_SYSTEM}") + CONTROLLERIP=ODL_SYSTEM_3_IP + echo 'Compressing karaf.log 3' Compressing karaf.log 3 + ssh 10.30.170.28 gzip --best /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + echo 'Fetching compressed karaf.log 3' Fetching compressed karaf.log 3 + scp 10.30.170.28:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz odl3_karaf.log.gz Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + ssh 10.30.170.28 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf.log.gz Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + scp 10.30.170.28:/tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log odl3_karaf_console.log Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + ssh 10.30.170.28 rm -f /tmp/karaf-0.21.3-SNAPSHOT/data/log/karaf_console.log Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. + echo 'Fetch GC logs' Fetch GC logs + mkdir -p gclogs-3 + scp '10.30.170.28:/tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log' gclogs-3/ Warning: Permanently added '10.30.170.28' (ECDSA) to the list of known hosts. scp: /tmp/karaf-0.21.3-SNAPSHOT/data/log/*.log: No such file or directory + echo 'Examine copied files' Examine copied files + ls -lt total 75588 drwxrwxr-x. 2 jenkins jenkins 6 Oct 13 05:36 gclogs-3 -rw-rw-r--. 1 jenkins jenkins 175337 Oct 13 05:36 odl3_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 406061 Oct 13 05:36 odl3_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Oct 13 05:36 gclogs-2 -rw-rw-r--. 1 jenkins jenkins 1720 Oct 13 05:36 odl2_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 842918 Oct 13 05:36 odl2_karaf.log.gz drwxrwxr-x. 2 jenkins jenkins 6 Oct 13 05:36 gclogs-1 -rw-rw-r--. 1 jenkins jenkins 1720 Oct 13 05:36 odl1_karaf_console.log -rw-rw-r--. 1 jenkins jenkins 596280 Oct 13 05:36 odl1_karaf.log.gz -rw-rw-r--. 1 jenkins jenkins 146407 Oct 13 05:36 karaf_3_2089_threads_after.log -rw-rw-r--. 1 jenkins jenkins 13543 Oct 13 05:36 ps_after.log -rw-rw-r--. 1 jenkins jenkins 146397 Oct 13 05:36 karaf_2_24231_threads_after.log -rw-rw-r--. 1 jenkins jenkins 127135 Oct 13 05:36 karaf_1_29703_threads_after.log -rw-rw-r--. 1 jenkins jenkins 308199 Oct 13 05:36 report.html -rw-rw-r--. 1 jenkins jenkins 3901094 Oct 13 05:36 log.html -rw-rw-r--. 1 jenkins jenkins 70282373 Oct 13 05:36 output.xml -rw-rw-r--. 1 jenkins jenkins 6069 Oct 12 23:55 testplan.txt -rw-rw-r--. 1 jenkins jenkins 112275 Oct 12 23:55 karaf_3_2089_threads_before.log -rw-rw-r--. 1 jenkins jenkins 13748 Oct 12 23:55 ps_before.log -rw-rw-r--. 1 jenkins jenkins 109957 Oct 12 23:55 karaf_2_2084_threads_before.log -rw-rw-r--. 1 jenkins jenkins 115242 Oct 12 23:55 karaf_1_2103_threads_before.log -rw-rw-r--. 1 jenkins jenkins 3106 Oct 12 23:52 post-startup-script.sh -rw-rw-r--. 1 jenkins jenkins 252 Oct 12 23:51 startup-script.sh -rw-rw-r--. 1 jenkins jenkins 3471 Oct 12 23:51 configuration-script.sh -rw-rw-r--. 1 jenkins jenkins 695 Oct 12 23:51 custom_shard_config.txt -rw-rw-r--. 1 jenkins jenkins 136 Oct 12 23:51 scriptplan.txt -rw-rw-r--. 1 jenkins jenkins 337 Oct 12 23:51 detect_variables.env -rw-rw-r--. 1 jenkins jenkins 2619 Oct 12 23:51 pom.xml -rw-rw-r--. 1 jenkins jenkins 92 Oct 12 23:51 set_variables.env -rw-rw-r--. 1 jenkins jenkins 313 Oct 12 23:51 slave_addresses.txt -rw-rw-r--. 1 jenkins jenkins 570 Oct 12 23:50 requirements.txt -rw-rw-r--. 1 jenkins jenkins 26 Oct 12 23:50 env.properties -rw-rw-r--. 1 jenkins jenkins 333 Oct 12 23:48 stack-parameters.yaml drwxrwxr-x. 7 jenkins jenkins 4096 Oct 12 23:47 test drwxrwxr-x. 2 jenkins jenkins 6 Oct 12 23:47 test@tmp -rw-rw-r--. 1 jenkins jenkins 1410 Oct 12 21:25 maven-metadata.xml + true [controller-csit-3node-clustering-tell-all-scandium] $ /bin/sh /tmp/jenkins3769153072051518829.sh Cleaning up Robot installation... $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5283 killed; [ssh-agent] Stopped. Recording plot data Robot results publisher started... INFO: Checking test criticality is deprecated and will be dropped in a future release! -Parsing output xml: Done! -Copying log files to build dir: Done! -Assigning results to build: Done! -Checking thresholds: Done! Done publishing Robot results. Build step 'Publish Robot Framework test results' changed build result to UNSTABLE [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins876593763315231135.sh Archiving csit artifacts mv: cannot stat '*_1.png': No such file or directory mv: cannot stat '/tmp/odl1_*': No such file or directory mv: cannot stat '*_2.png': No such file or directory mv: cannot stat '/tmp/odl2_*': No such file or directory mv: cannot stat '*_3.png': No such file or directory mv: cannot stat '/tmp/odl3_*': No such file or directory % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 3208k 0 3208k 0 0 4927k 0 --:--:-- --:--:-- --:--:-- 4920k 100 5598k 0 5598k 0 0 5025k 0 --:--:-- 0:00:01 --:--:-- 5029k Archive: robot-plugin.zip inflating: ./archives/robot-plugin/log.html inflating: ./archives/robot-plugin/output.xml inflating: ./archives/robot-plugin/report.html mv: cannot stat '*.log.gz': No such file or directory mv: cannot stat '*.csv': No such file or directory mv: cannot stat '*.png': No such file or directory [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins1984503913717786364.sh [PostBuildScript] - [INFO] Executing post build scripts. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content OS_CLOUD=vex OS_STACK_NAME=releng-controller-csit-3node-clustering-tell-all-scandium-77 [EnvInject] - Variables injected successfully. provisioning config files... copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins18283868832903012929.sh ---> openstack-stack-delete.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.5.0 which is incompatible. lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH INFO: Stack cost retrieval disabled, setting cost to 0 INFO: Deleting stack releng-controller-csit-3node-clustering-tell-all-scandium-77 Successfully deleted stack releng-controller-csit-3node-clustering-tell-all-scandium-77 [PostBuildScript] - [INFO] Executing post build scripts. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins15018750119074581623.sh ---> sysstat.sh [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins4646862227251810665.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=redhat + workspace=/w/workspace/controller-csit-3node-clustering-tell-all-scandium + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + rpm -qa + sort + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/controller-csit-3node-clustering-tell-all-scandium ']' + mkdir -p /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/controller-csit-3node-clustering-tell-all-scandium/archives/ [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins14564271930964215196.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH INFO: Running in OpenStack, capturing instance metadata [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins11140864427549301610.sh provisioning config files... Could not find credentials [logs] for controller-csit-3node-clustering-tell-all-scandium #77 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/controller-csit-3node-clustering-tell-all-scandium@tmp/config15868008734196927821tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] Run condition [Regular expression match] enabling perform for step [Provide Configuration files] provisioning config files... copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins4052740487677115029.sh ---> create-netrc.sh WARN: Log server credential not found. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins2564821297154455925.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins8320303134594851998.sh ---> sudo-logs.sh Archiving 'sudo' log.. [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash /tmp/jenkins181280416891293298.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH DEBUG: total: 0 INFO: Retrieving Stack Cost... INFO: Retrieving Pricing Info for: v3-standard-2 INFO: Archiving Costs [controller-csit-3node-clustering-tell-all-scandium] $ /bin/bash -l /tmp/jenkins17992580116846365961.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 3.10.13 * 3.11.7 (set by /w/workspace/controller-csit-3node-clustering-tell-all-scandium/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-llNL from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-llNL/bin to PATH WARNING: Nexus logging server not set INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-tell-all-scandium/77/ INFO: archiving logs to S3 ---> uname -a: Linux prd-centos8-robot-2c-8g-3091.novalocal 4.18.0-553.5.1.el8.x86_64 #1 SMP Tue May 21 05:46:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 2 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 2 ---> df -h: Filesystem Size Used Avail Use% Mounted on devtmpfs 3.8G 0 3.8G 0% /dev tmpfs 3.8G 0 3.8G 0% /dev/shm tmpfs 3.8G 17M 3.8G 1% /run tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup /dev/vda1 40G 8.5G 32G 22% / tmpfs 770M 0 770M 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 7697 672 4678 19 2346 6726 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:3d:35:d7 brd ff:ff:ff:ff:ff:ff altname enp0s3 altname ens3 inet 10.30.170.36/23 brd 10.30.171.255 scope global dynamic noprefixroute eth0 valid_lft 65314sec preferred_lft 65314sec inet6 fe80::f816:3eff:fe3d:35d7/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-3091.novalocal) 10/13/2025 _x86_64_ (2 CPU) 12:00:01 AM tps rtps wtps bread/s bwrtn/s 12:01:01 AM 1.10 0.00 1.10 0.00 208.60 12:02:01 AM 0.42 0.12 0.30 2.13 14.07 12:03:01 AM 1.38 0.03 1.35 1.87 53.03 12:04:01 AM 0.23 0.00 0.23 0.00 5.87 12:05:01 AM 0.18 0.03 0.15 1.33 1.90 12:06:01 AM 0.20 0.00 0.20 0.00 4.93 12:07:01 AM 0.23 0.02 0.22 0.53 3.68 12:08:01 AM 0.63 0.05 0.58 7.06 12.80 12:09:01 AM 0.53 0.00 0.53 0.00 7.22 12:10:01 AM 0.33 0.08 0.25 2.53 7.43 12:11:01 AM 0.93 0.23 0.70 4.40 19.09 12:12:01 AM 0.57 0.00 0.57 0.00 12.45 12:13:01 AM 0.30 0.00 0.30 0.00 7.22 12:14:01 AM 0.28 0.00 0.28 0.00 3.37 12:15:01 AM 0.22 0.00 0.22 0.00 6.35 12:16:01 AM 0.18 0.00 0.18 0.00 2.68 12:17:01 AM 6.05 5.75 0.30 555.55 7.78 12:18:01 AM 2.98 0.00 2.98 0.00 72.67 12:19:01 AM 0.22 0.00 0.22 0.00 4.15 12:20:01 AM 0.25 0.00 0.25 0.00 4.75 12:21:01 AM 0.33 0.00 0.33 0.00 6.56 12:22:01 AM 0.27 0.00 0.27 0.00 3.62 12:23:01 AM 0.28 0.00 0.28 0.00 5.58 12:24:01 AM 0.15 0.00 0.15 0.00 3.73 12:25:01 AM 0.15 0.00 0.15 0.00 1.22 12:26:01 AM 0.20 0.00 0.20 0.00 5.77 12:27:01 AM 0.20 0.00 0.20 0.00 2.00 12:28:01 AM 0.27 0.00 0.27 0.00 6.25 12:29:01 AM 0.12 0.00 0.12 0.00 3.33 12:30:01 AM 0.25 0.00 0.25 0.00 3.17 12:31:01 AM 0.38 0.00 0.38 0.00 7.43 12:32:01 AM 0.25 0.00 0.25 0.00 3.22 12:33:01 AM 0.27 0.00 0.27 0.00 4.63 12:34:01 AM 0.13 0.00 0.13 0.00 1.18 12:35:01 AM 0.22 0.00 0.22 0.00 2.37 12:36:01 AM 0.15 0.00 0.15 0.00 2.05 12:37:01 AM 0.23 0.00 0.23 0.00 2.12 12:38:01 AM 0.20 0.00 0.20 0.00 3.43 12:39:02 AM 0.17 0.02 0.15 0.13 6.67 12:40:01 AM 0.61 0.00 0.61 0.00 18.93 12:41:01 AM 0.58 0.00 0.58 0.00 18.96 12:42:01 AM 0.65 0.00 0.65 0.00 19.18 12:43:01 AM 0.65 0.00 0.65 0.00 20.39 12:44:01 AM 0.57 0.00 0.57 0.00 18.40 12:45:01 AM 0.32 0.00 0.32 0.00 13.30 12:46:01 AM 0.18 0.00 0.18 0.00 21.85 12:47:01 AM 0.23 0.00 0.23 0.00 8.25 12:48:01 AM 0.45 0.00 0.45 0.00 6.62 12:49:01 AM 0.32 0.00 0.32 0.00 5.85 12:50:01 AM 0.42 0.00 0.42 0.00 4.60 12:51:01 AM 0.78 0.00 0.78 0.00 14.18 12:52:01 AM 0.38 0.00 0.38 0.00 4.20 12:53:01 AM 0.48 0.00 0.48 0.00 10.93 12:54:01 AM 0.13 0.00 0.13 0.00 2.27 12:55:01 AM 0.18 0.00 0.18 0.00 5.36 12:56:01 AM 0.23 0.00 0.23 0.00 3.47 12:57:01 AM 0.25 0.00 0.25 0.00 3.63 12:58:01 AM 0.27 0.00 0.27 0.00 4.77 12:59:01 AM 0.13 0.00 0.13 0.00 2.67 01:00:01 AM 0.13 0.00 0.13 0.00 12.53 01:01:01 AM 0.18 0.00 0.18 0.00 16.60 01:02:01 AM 0.30 0.00 0.30 0.00 12.23 01:03:01 AM 0.32 0.00 0.32 0.00 19.61 01:04:01 AM 0.15 0.00 0.15 0.00 16.39 01:05:01 AM 0.12 0.00 0.12 0.00 8.80 01:06:01 AM 0.15 0.00 0.15 0.00 12.66 01:07:01 AM 0.27 0.00 0.27 0.00 5.28 01:08:01 AM 0.22 0.00 0.22 0.00 3.68 01:09:01 AM 0.23 0.00 0.23 0.00 9.25 01:10:01 AM 0.25 0.00 0.25 0.00 15.60 01:11:01 AM 0.58 0.00 0.58 0.00 17.88 01:12:01 AM 0.52 0.00 0.52 0.00 17.13 01:13:01 AM 0.25 0.00 0.25 0.00 10.96 01:14:01 AM 0.15 0.00 0.15 0.00 16.26 01:15:01 AM 0.37 0.00 0.37 0.00 19.76 01:16:01 AM 0.40 0.00 0.40 0.00 24.51 01:17:01 AM 0.35 0.00 0.35 0.00 8.00 01:18:01 AM 0.20 0.00 0.20 0.00 3.47 01:19:01 AM 0.12 0.00 0.12 0.00 4.08 01:20:01 AM 0.18 0.00 0.18 0.00 1.73 01:21:01 AM 0.17 0.00 0.17 0.00 4.05 01:22:01 AM 0.28 0.00 0.28 0.00 5.10 01:23:01 AM 0.22 0.00 0.22 0.00 3.02 01:24:01 AM 0.18 0.00 0.18 0.00 8.87 01:25:01 AM 0.27 0.00 0.27 0.00 6.05 01:26:01 AM 0.15 0.00 0.15 0.00 2.25 01:27:01 AM 0.23 0.00 0.23 0.00 5.05 01:28:01 AM 0.32 0.00 0.32 0.00 20.80 01:29:01 AM 0.35 0.00 0.35 0.00 12.93 01:30:01 AM 0.17 0.00 0.17 0.00 16.43 01:31:01 AM 0.27 0.00 0.27 0.00 12.56 01:32:01 AM 0.33 0.00 0.33 0.00 19.88 01:33:01 AM 0.28 0.00 0.28 0.00 11.71 01:34:01 AM 0.15 0.00 0.15 0.00 11.23 01:35:01 AM 0.17 0.00 0.17 0.00 9.77 01:36:01 AM 0.18 0.00 0.18 0.00 8.42 01:37:01 AM 0.28 0.00 0.28 0.00 20.91 01:38:01 AM 0.38 0.00 0.38 0.00 16.10 01:39:01 AM 0.20 0.00 0.20 0.00 13.71 01:40:01 AM 0.97 0.00 0.97 0.00 30.29 01:41:01 AM 0.32 0.00 0.32 0.00 12.56 01:42:01 AM 0.17 0.00 0.17 0.00 15.06 01:43:01 AM 0.32 0.00 0.32 0.00 6.02 01:44:01 AM 0.25 0.00 0.25 0.00 18.38 01:45:01 AM 0.18 0.00 0.18 0.00 14.95 01:46:01 AM 0.18 0.00 0.18 0.00 17.49 01:47:01 AM 0.20 0.00 0.20 0.00 9.46 01:48:02 AM 0.27 0.00 0.27 0.00 19.31 01:49:01 AM 0.15 0.00 0.15 0.00 24.13 01:50:01 AM 0.13 0.00 0.13 0.00 10.00 01:51:01 AM 0.35 0.00 0.35 0.00 4.87 01:52:01 AM 0.32 0.00 0.32 0.00 6.73 01:53:01 AM 0.35 0.00 0.35 0.00 4.95 01:54:01 AM 0.12 0.00 0.12 0.00 0.93 01:55:01 AM 0.17 0.00 0.17 0.00 4.13 01:56:01 AM 0.10 0.00 0.10 0.00 0.63 01:57:01 AM 0.23 0.00 0.23 0.00 9.08 01:58:01 AM 0.25 0.00 0.25 0.00 6.30 01:59:01 AM 0.13 0.00 0.13 0.00 1.43 02:00:01 AM 0.08 0.00 0.08 0.00 0.65 02:01:01 AM 0.27 0.00 0.27 0.00 14.68 02:02:01 AM 0.23 0.00 0.23 0.00 11.04 02:03:01 AM 0.38 0.00 0.38 0.00 23.35 02:04:01 AM 0.17 0.00 0.17 0.00 8.83 02:05:01 AM 0.38 0.00 0.38 0.00 23.08 02:06:01 AM 0.13 0.00 0.13 0.00 9.47 02:07:01 AM 0.23 0.00 0.23 0.00 16.36 02:08:01 AM 0.23 0.00 0.23 0.00 4.65 02:09:01 AM 0.17 0.00 0.17 0.00 14.40 02:10:01 AM 0.17 0.00 0.17 0.00 17.59 02:11:01 AM 0.17 0.00 0.17 0.00 9.90 02:12:01 AM 0.30 0.00 0.30 0.00 17.01 02:13:01 AM 0.33 0.00 0.33 0.00 18.81 02:14:01 AM 0.15 0.00 0.15 0.00 8.68 02:15:01 AM 0.17 0.00 0.17 0.00 17.38 02:16:01 AM 0.17 0.00 0.17 0.00 18.85 02:17:01 AM 0.25 0.00 0.25 0.00 3.52 02:18:01 AM 0.22 0.00 0.22 0.00 5.90 02:19:01 AM 0.12 0.00 0.12 0.00 0.95 02:20:01 AM 0.15 0.00 0.15 0.00 1.47 02:21:01 AM 0.45 0.00 0.45 0.00 8.92 02:22:01 AM 0.27 0.00 0.27 0.00 4.07 02:23:01 AM 0.23 0.00 0.23 0.00 9.10 02:24:01 AM 0.15 0.00 0.15 0.00 4.80 02:25:01 AM 0.10 0.00 0.10 0.00 1.20 02:26:01 AM 0.20 0.00 0.20 0.00 2.35 02:27:01 AM 0.30 0.00 0.30 0.00 6.37 02:28:01 AM 0.20 0.00 0.20 0.00 3.23 02:29:01 AM 0.28 0.00 0.28 0.00 5.98 02:30:01 AM 0.15 0.00 0.15 0.00 1.47 02:31:01 AM 0.15 0.00 0.15 0.00 3.92 02:32:01 AM 0.30 0.00 0.30 0.00 5.12 02:33:01 AM 0.30 0.00 0.30 0.00 6.98 02:34:01 AM 0.10 0.00 0.10 0.00 1.05 02:35:01 AM 0.15 0.00 0.15 0.00 4.12 02:36:01 AM 0.10 0.00 0.10 0.00 0.93 02:37:01 AM 0.32 0.00 0.32 0.00 6.85 02:38:01 AM 0.30 0.00 0.30 0.00 5.56 02:39:01 AM 0.25 0.00 0.25 0.00 6.30 02:40:01 AM 0.22 0.00 0.22 0.00 17.71 02:41:01 AM 0.25 0.00 0.25 0.00 13.63 02:42:01 AM 0.25 0.00 0.25 0.00 20.36 02:43:01 AM 0.40 0.00 0.40 0.00 13.81 02:44:01 AM 0.45 0.00 0.45 0.00 21.26 02:45:01 AM 0.53 0.00 0.53 0.00 18.66 02:46:01 AM 0.40 0.00 0.40 0.00 8.68 02:47:01 AM 0.28 0.00 0.28 0.00 2.63 02:48:01 AM 0.42 0.00 0.42 0.00 6.08 02:49:01 AM 0.32 0.00 0.32 0.00 6.38 02:50:01 AM 0.32 0.00 0.32 0.00 3.80 02:51:01 AM 0.30 0.00 0.30 0.00 7.35 02:52:01 AM 0.50 0.00 0.50 0.00 6.92 02:53:01 AM 0.47 0.00 0.47 0.00 8.90 02:54:01 AM 0.32 0.00 0.32 0.00 3.68 02:55:01 AM 0.33 0.00 0.33 0.00 6.55 02:56:01 AM 0.33 0.00 0.33 0.00 3.62 02:57:01 AM 0.30 0.00 0.30 0.00 6.50 02:58:01 AM 0.28 0.00 0.28 0.00 4.43 02:59:02 AM 0.18 0.00 0.18 0.00 1.45 03:00:01 AM 0.39 0.00 0.39 0.00 18.01 03:01:01 AM 0.22 0.00 0.22 0.00 16.48 03:02:01 AM 0.40 0.00 0.40 0.00 19.31 03:03:01 AM 0.67 0.00 0.67 0.00 20.64 03:04:01 AM 0.43 0.00 0.43 0.00 11.68 03:05:01 AM 0.17 0.00 0.17 0.00 16.56 03:06:01 AM 0.12 0.00 0.12 0.00 9.73 03:07:01 AM 0.18 0.00 0.18 0.00 5.42 03:08:01 AM 0.27 0.00 0.27 0.00 4.32 03:09:01 AM 0.15 0.00 0.15 0.00 4.28 03:10:01 AM 0.83 0.00 0.83 0.00 13.30 03:11:01 AM 0.25 0.00 0.25 0.00 6.31 03:12:01 AM 0.18 0.00 0.18 0.00 2.60 03:13:01 AM 0.25 0.00 0.25 0.00 6.67 03:14:01 AM 0.17 0.00 0.17 0.00 1.62 03:15:01 AM 0.13 0.00 0.13 0.00 4.52 03:16:01 AM 0.18 0.00 0.18 0.00 2.05 03:17:01 AM 0.30 0.00 0.30 0.00 6.52 03:18:01 AM 0.30 0.00 0.30 0.00 5.35 03:19:01 AM 0.17 0.00 0.17 0.00 4.67 03:20:01 AM 0.13 0.00 0.13 0.00 14.13 03:21:01 AM 0.57 0.00 0.57 0.00 18.84 03:22:01 AM 0.27 0.00 0.27 0.00 12.48 03:23:01 AM 0.30 0.00 0.30 0.00 19.36 03:24:01 AM 0.27 0.00 0.27 0.00 9.47 03:25:01 AM 0.18 0.00 0.18 0.00 16.95 03:26:01 AM 0.10 0.00 0.10 0.00 9.90 03:27:01 AM 0.20 0.00 0.20 0.00 5.43 03:28:01 AM 0.20 0.00 0.20 0.00 3.57 03:29:01 AM 0.13 0.00 0.13 0.00 4.27 03:30:01 AM 0.13 0.00 0.13 0.00 1.43 03:31:01 AM 0.30 0.00 0.30 0.00 6.46 03:32:01 AM 0.37 0.00 0.37 0.00 5.67 03:33:01 AM 0.27 0.00 0.27 0.00 6.45 03:34:01 AM 0.18 0.00 0.18 0.00 1.98 03:35:01 AM 0.12 0.00 0.12 0.00 3.87 03:36:01 AM 0.20 0.00 0.20 0.00 2.62 03:37:01 AM 0.28 0.00 0.28 0.00 7.27 03:38:01 AM 0.27 0.00 0.27 0.00 4.23 03:39:01 AM 0.20 0.00 0.20 0.00 9.65 03:40:01 AM 0.13 0.00 0.13 0.00 6.28 03:41:01 AM 0.27 0.00 0.27 0.00 16.15 03:42:01 AM 0.37 0.00 0.37 0.00 22.63 03:43:01 AM 0.45 0.00 0.45 0.00 18.86 03:44:01 AM 0.48 0.00 0.48 0.00 16.65 03:45:01 AM 0.50 0.00 0.50 0.00 17.84 03:46:01 AM 0.40 0.00 0.40 0.00 26.46 03:47:01 AM 0.23 0.00 0.23 0.00 6.03 03:48:01 AM 0.30 0.00 0.30 0.00 4.65 03:49:01 AM 0.20 0.00 0.20 0.00 4.75 03:50:01 AM 0.27 0.00 0.27 0.00 4.28 03:51:01 AM 0.40 0.00 0.40 0.00 6.92 03:52:01 AM 0.50 0.00 0.50 0.00 5.76 03:53:01 AM 0.40 0.00 0.40 0.00 5.03 03:54:01 AM 0.18 0.00 0.18 0.00 8.78 03:55:01 AM 0.27 0.00 0.27 0.00 5.22 03:56:01 AM 0.17 0.00 0.17 0.00 2.02 03:57:01 AM 0.27 0.00 0.27 0.00 5.52 03:58:01 AM 0.30 0.00 0.30 0.00 13.86 03:59:01 AM 0.15 0.00 0.15 0.00 14.80 04:00:01 AM 0.13 0.00 0.13 0.00 14.26 04:01:01 AM 0.17 0.00 0.17 0.00 16.43 04:02:01 AM 0.30 0.00 0.30 0.00 11.98 04:03:01 AM 0.33 0.00 0.33 0.00 18.55 04:04:01 AM 0.13 0.00 0.13 0.00 11.86 04:05:01 AM 0.10 0.00 0.10 0.00 4.27 04:06:01 AM 0.37 0.00 0.37 0.00 18.13 04:07:01 AM 0.55 0.00 0.55 0.00 18.15 04:08:01 AM 0.63 0.00 0.63 0.00 20.78 04:09:02 AM 0.72 0.00 0.72 0.00 20.35 04:10:01 AM 0.54 0.00 0.54 0.00 18.47 04:11:01 AM 0.58 0.00 0.58 0.00 18.58 04:12:01 AM 0.37 0.00 0.37 0.00 13.16 04:13:01 AM 0.50 0.00 0.50 0.00 13.58 04:14:01 AM 0.25 0.00 0.25 0.00 13.85 04:15:01 AM 0.12 0.00 0.12 0.00 8.40 04:16:01 AM 0.23 0.00 0.23 0.00 17.85 04:17:01 AM 0.25 0.00 0.25 0.00 17.49 04:18:01 AM 1.20 0.00 1.20 0.00 35.26 04:19:01 AM 0.32 0.00 0.32 0.00 28.01 04:20:01 AM 0.28 0.00 0.28 0.00 7.58 04:21:01 AM 0.37 0.00 0.37 0.00 4.37 04:22:01 AM 0.38 0.00 0.38 0.00 6.30 04:23:01 AM 0.28 0.00 0.28 0.00 4.35 04:24:01 AM 0.12 0.00 0.12 0.00 0.80 04:25:01 AM 0.27 0.00 0.27 0.00 5.61 04:26:01 AM 0.20 0.00 0.20 0.00 2.27 04:27:01 AM 0.17 0.00 0.17 0.00 7.32 04:28:01 AM 0.27 0.00 0.27 0.00 10.93 04:29:01 AM 0.35 0.00 0.35 0.00 4.23 04:30:01 AM 0.33 0.00 0.33 0.00 4.68 04:31:01 AM 0.23 0.00 0.23 0.00 4.97 04:32:01 AM 0.28 0.00 0.28 0.00 6.15 04:33:01 AM 0.33 0.00 0.33 0.00 6.73 04:34:01 AM 0.18 0.00 0.18 0.00 6.56 04:35:01 AM 0.13 0.00 0.13 0.00 1.43 04:36:01 AM 0.12 0.00 0.12 0.00 5.50 04:37:01 AM 0.28 0.00 0.28 0.00 13.90 04:38:01 AM 0.25 0.00 0.25 0.00 18.38 04:39:01 AM 0.25 0.00 0.25 0.00 15.46 04:40:01 AM 0.23 0.00 0.23 0.00 14.51 04:41:01 AM 0.42 0.00 0.42 0.00 18.63 04:42:01 AM 0.23 0.00 0.23 0.00 11.51 04:43:01 AM 0.27 0.00 0.27 0.00 28.59 04:44:01 AM 0.17 0.00 0.17 0.00 4.97 04:45:01 AM 0.13 0.00 0.13 0.00 0.92 04:46:01 AM 0.12 0.00 0.12 0.00 3.87 04:47:01 AM 0.28 0.00 0.28 0.00 4.08 04:48:01 AM 0.22 0.00 0.22 0.00 5.92 04:49:01 AM 0.28 0.00 0.28 0.00 3.30 04:50:01 AM 0.15 0.00 0.15 0.00 1.60 04:51:01 AM 0.17 0.00 0.17 0.00 8.71 04:52:01 AM 0.38 0.00 0.38 0.00 10.35 04:53:01 AM 0.42 0.00 0.42 0.00 5.75 04:54:01 AM 0.40 0.00 0.40 0.00 7.25 04:55:01 AM 0.13 0.00 0.13 0.00 3.08 04:56:01 AM 0.28 0.00 0.28 0.00 5.40 04:57:01 AM 0.32 0.00 0.32 0.00 10.78 04:58:01 AM 0.20 0.00 0.20 0.00 3.73 04:59:01 AM 0.10 0.00 0.10 0.00 1.20 05:00:01 AM 0.18 0.00 0.18 0.00 11.10 05:01:01 AM 0.25 0.00 0.25 0.00 12.05 05:02:01 AM 0.25 0.00 0.25 0.00 15.61 05:03:01 AM 0.63 0.00 0.63 0.00 24.81 05:04:01 AM 0.15 0.00 0.15 0.00 10.43 05:05:01 AM 0.23 0.00 0.23 0.00 16.01 05:06:01 AM 0.15 0.00 0.15 0.00 12.13 05:07:01 AM 0.25 0.00 0.25 0.00 24.68 05:08:01 AM 0.33 0.00 0.33 0.00 16.25 05:09:01 AM 0.27 0.00 0.27 0.00 11.63 05:10:01 AM 0.50 0.00 0.50 0.00 15.21 05:11:01 AM 0.43 0.00 0.43 0.00 14.16 05:12:01 AM 0.38 0.00 0.38 0.00 13.21 05:13:01 AM 0.27 0.00 0.27 0.00 10.66 05:14:01 AM 0.15 0.00 0.15 0.00 7.33 05:15:01 AM 0.17 0.00 0.17 0.00 2.70 05:16:01 AM 0.18 0.00 0.18 0.00 2.98 05:17:01 AM 0.35 0.00 0.35 0.00 11.73 05:18:02 AM 0.45 0.00 0.45 0.00 19.84 05:19:01 AM 0.22 0.00 0.22 0.00 18.06 05:20:01 AM 0.13 0.00 0.13 0.00 8.53 05:21:01 AM 0.17 0.00 0.17 0.00 16.71 05:22:01 AM 0.30 0.00 0.30 0.00 16.79 05:23:01 AM 0.32 0.00 0.32 0.00 15.46 05:24:01 AM 0.27 0.00 0.27 0.00 28.91 05:25:01 AM 0.22 0.00 0.22 0.00 10.66 05:26:01 AM 0.12 0.00 0.12 0.00 7.37 05:27:01 AM 0.22 0.00 0.22 0.00 14.66 05:28:01 AM 0.23 0.00 0.23 0.00 11.76 05:29:01 AM 0.18 0.00 0.18 0.00 14.15 05:30:01 AM 0.12 0.00 0.12 0.00 9.37 05:31:01 AM 0.43 0.00 0.43 0.00 15.23 05:32:01 AM 0.30 0.00 0.30 0.00 13.96 05:33:01 AM 0.28 0.00 0.28 0.00 13.06 05:34:01 AM 0.15 0.00 0.15 0.00 22.13 05:35:01 AM 0.13 0.00 0.13 0.00 9.73 05:36:01 AM 0.13 0.00 0.13 0.00 11.60 05:37:01 AM 3.80 0.28 3.52 33.86 152.01 05:38:01 AM 35.67 0.42 35.25 48.25 4238.17 Average: 0.42 0.02 0.40 1.95 23.76 12:00:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 12:01:01 AM 4851768 6959188 3030664 38.45 2688 2274692 774252 8.67 269016 2380568 56 12:02:01 AM 4849968 6957944 3032464 38.47 2688 2275240 773084 8.66 269336 2382244 316 12:03:01 AM 4847732 6956204 3034700 38.50 2688 2275736 773084 8.66 269612 2384368 84 12:04:01 AM 4847636 6956108 3034796 38.50 2688 2275736 773084 8.66 269612 2384300 4 12:05:01 AM 4847152 6955744 3035280 38.51 2688 2275856 773084 8.66 269616 2384748 84 12:06:01 AM 4847192 6955780 3035240 38.51 2688 2275856 773084 8.66 269616 2384728 4 12:07:01 AM 4846472 6955176 3035960 38.52 2688 2275980 774372 8.67 269616 2385528 16 12:08:01 AM 4846192 6955128 3036240 38.52 2688 2276204 773048 8.66 269644 2385824 4 12:09:01 AM 4846308 6955244 3036124 38.52 2688 2276204 773048 8.66 269644 2385696 4 12:10:01 AM 4843408 6952572 3039024 38.55 2688 2276432 778068 8.71 269852 2387752 56 12:11:01 AM 4842560 6952016 3039872 38.57 2688 2276724 778068 8.71 269904 2389100 96 12:12:01 AM 4842352 6951880 3040080 38.57 2688 2276796 778068 8.71 269904 2389184 76 12:13:01 AM 4842392 6951924 3040040 38.57 2688 2276800 778068 8.71 269904 2389140 4 12:14:01 AM 4842480 6952072 3039952 38.57 2688 2276860 778068 8.71 269904 2389132 64 12:15:01 AM 4842332 6951988 3040100 38.57 2688 2276924 778068 8.71 269904 2389196 4 12:16:01 AM 4842536 6952196 3039896 38.57 2688 2276928 778068 8.71 269904 2389200 4 12:17:01 AM 4825376 6951792 3057056 38.78 2688 2293640 776208 8.69 272248 2403760 664 12:18:01 AM 4825076 6951552 3057356 38.79 2688 2293700 776208 8.69 272248 2404036 16 12:19:01 AM 4825244 6951724 3057188 38.78 2688 2293704 776208 8.69 272248 2403836 12 12:20:01 AM 4824804 6951404 3057628 38.79 2688 2293824 779524 8.73 272248 2404076 72 12:21:01 AM 4825196 6951804 3057236 38.79 2688 2293828 779524 8.73 272248 2403800 4 12:22:01 AM 4825364 6952012 3057068 38.78 2688 2293868 779524 8.73 272248 2403840 56 12:23:01 AM 4825144 6951872 3057288 38.79 2688 2293948 779524 8.73 272248 2403988 72 12:24:01 AM 4825100 6951832 3057332 38.79 2688 2293952 779524 8.73 272252 2403920 4 12:25:01 AM 4824816 6951604 3057616 38.79 2688 2294008 779524 8.73 272252 2404300 76 12:26:01 AM 4824892 6951740 3057540 38.79 2688 2294068 779524 8.73 272252 2404296 4 12:27:01 AM 4824996 6951848 3057436 38.79 2688 2294072 779524 8.73 272252 2404164 4 12:28:01 AM 4824624 6951532 3057808 38.79 2688 2294128 779524 8.73 272252 2404628 4 12:29:01 AM 4824408 6951380 3058024 38.80 2688 2294192 779524 8.73 272252 2404580 4 12:30:01 AM 4824224 6951196 3058208 38.80 2688 2294192 778076 8.71 272280 2404756 12 12:31:01 AM 4822420 6949472 3060012 38.82 2688 2294268 778076 8.71 272280 2406516 24 12:32:01 AM 4822404 6949452 3060028 38.82 2688 2294268 778076 8.71 272280 2406620 4 12:33:01 AM 4822136 6949188 3060296 38.82 2688 2294272 778076 8.71 272280 2406752 12 12:34:01 AM 4822128 6949180 3060304 38.82 2688 2294272 778076 8.71 272280 2406732 8 12:35:01 AM 4822536 6949588 3059896 38.82 2688 2294272 778076 8.71 272280 2406472 4 12:36:01 AM 4822004 6949060 3060428 38.83 2688 2294276 778076 8.71 272280 2407004 4 12:37:01 AM 4822392 6949448 3060040 38.82 2688 2294276 778076 8.71 272280 2406480 4 12:38:01 AM 4822476 6949532 3059956 38.82 2688 2294276 778076 8.71 272280 2406664 4 12:39:02 AM 4822160 6949384 3060272 38.82 2688 2294444 778076 8.71 272280 2406924 20 12:40:01 AM 4821576 6949180 3060856 38.83 2688 2294832 780596 8.74 272280 2407424 24 12:41:01 AM 4821408 6949396 3061024 38.83 2688 2295212 780596 8.74 272280 2407708 40 12:42:01 AM 4820484 6948856 3061948 38.85 2688 2295596 780596 8.74 272280 2408508 32 12:43:01 AM 4820432 6949184 3062000 38.85 2688 2295980 780596 8.74 272280 2408552 28 12:44:01 AM 4820048 6949180 3062384 38.85 2688 2296360 780596 8.74 272280 2409020 4 12:45:01 AM 4819200 6948716 3063232 38.86 2688 2296744 780596 8.74 272280 2409688 100 12:46:01 AM 4819244 6949400 3063188 38.86 2688 2297376 780596 8.74 272280 2410000 136 12:47:01 AM 4818960 6949188 3063472 38.86 2688 2297448 780596 8.74 272280 2410076 4 12:48:01 AM 4818828 6949060 3063604 38.87 2688 2297452 780596 8.74 272280 2410252 4 12:49:01 AM 4818800 6949112 3063632 38.87 2688 2297532 780596 8.74 272280 2410312 4 12:50:01 AM 4818416 6948728 3064016 38.87 2688 2297532 799496 8.95 272280 2410436 4 12:51:01 AM 4819068 6949464 3063364 38.86 2688 2297612 775160 8.68 272276 2410148 4 12:52:01 AM 4819040 6949436 3063392 38.86 2688 2297612 775160 8.68 272276 2410148 4 12:53:01 AM 4818056 6948636 3064376 38.88 2688 2297796 775160 8.68 272276 2410984 40 12:54:01 AM 4818208 6948836 3064224 38.87 2688 2297844 775160 8.68 272276 2410964 48 12:55:01 AM 4818280 6948968 3064152 38.87 2688 2297904 775160 8.68 272276 2411044 4 12:56:01 AM 4818244 6948936 3064188 38.87 2688 2297908 775160 8.68 272276 2411048 4 12:57:01 AM 4818216 6948932 3064216 38.87 2688 2297932 775160 8.68 272276 2411072 4 12:58:01 AM 4817772 6948496 3064660 38.88 2688 2297940 775160 8.68 272276 2411376 24 12:59:01 AM 4817976 6948752 3064456 38.88 2688 2297992 775160 8.68 272276 2411164 24 01:00:01 AM 4817144 6948364 3065288 38.89 2688 2298444 790536 8.85 272276 2411972 128 01:01:01 AM 4816404 6948012 3066028 38.90 2688 2298832 790536 8.85 272276 2412744 56 01:02:01 AM 4816308 6948304 3066124 38.90 2688 2299212 790536 8.85 272300 2412944 208 01:03:01 AM 4816140 6948508 3066292 38.90 2688 2299592 790536 8.85 272300 2413160 128 01:04:01 AM 4815868 6948624 3066564 38.90 2688 2299980 790536 8.85 272300 2413268 56 01:05:01 AM 4815072 6948208 3067360 38.91 2688 2300360 790536 8.85 272300 2414112 208 01:06:01 AM 4815536 6948836 3066896 38.91 2688 2300516 790536 8.85 272412 2413708 16 01:07:01 AM 4815476 6948816 3066956 38.91 2688 2300556 773852 8.66 272412 2413748 4 01:08:01 AM 4814964 6948316 3067468 38.92 2688 2300568 773852 8.66 272412 2414032 28 01:09:01 AM 4816992 6950556 3065440 38.89 2688 2300780 773852 8.66 272412 2412144 20 01:10:01 AM 4816108 6950052 3066324 38.90 2688 2301160 771912 8.64 272412 2412800 4 01:11:01 AM 4815932 6950264 3066500 38.90 2688 2301544 771912 8.64 272412 2412972 40 01:12:01 AM 4815736 6950440 3066696 38.91 2688 2301924 771912 8.64 272412 2413384 52 01:13:01 AM 4815508 6950600 3066924 38.91 2688 2302312 771912 8.64 272412 2413704 208 01:14:01 AM 4815180 6950652 3067252 38.91 2688 2302692 771912 8.64 272412 2414132 132 01:15:01 AM 4814784 6950644 3067648 38.92 2688 2303072 771912 8.64 272412 2414404 24 01:16:01 AM 4813516 6950052 3068916 38.93 2688 2303748 771912 8.64 272412 2415352 92 01:17:01 AM 4813720 6950256 3068712 38.93 2688 2303748 771912 8.64 272412 2415284 12 01:18:01 AM 4813868 6950404 3068564 38.93 2688 2303748 771912 8.64 272412 2415448 4 01:19:01 AM 4813728 6950348 3068704 38.93 2688 2303832 771912 8.64 272412 2415528 4 01:20:01 AM 4813016 6949636 3069416 38.94 2688 2303832 768824 8.61 272412 2415792 4 01:21:01 AM 4813776 6950488 3068656 38.93 2688 2303916 768824 8.61 272412 2415652 4 01:22:01 AM 4813156 6949872 3069276 38.94 2688 2303920 768824 8.61 272412 2415812 4 01:23:01 AM 4813356 6950244 3069076 38.94 2688 2304092 768824 8.61 272412 2415624 180 01:24:01 AM 4813540 6950476 3068892 38.93 2688 2304140 768824 8.61 272412 2415628 16 01:25:01 AM 4813384 6950388 3069048 38.94 2688 2304208 768824 8.61 272412 2415668 4 01:26:01 AM 4813540 6950544 3068892 38.93 2688 2304208 768824 8.61 272412 2415684 4 01:27:01 AM 4811100 6948224 3071332 38.96 2688 2304328 789720 8.84 272412 2417844 64 01:28:01 AM 4812800 6950328 3069632 38.94 2688 2304740 789720 8.84 272412 2416256 88 01:29:01 AM 4812620 6950544 3069812 38.94 2688 2305128 789720 8.84 272412 2416592 88 01:30:01 AM 4811548 6949856 3070884 38.96 2688 2305520 770068 8.62 272412 2417328 24 01:31:01 AM 4811540 6950232 3070892 38.96 2688 2305904 770068 8.62 272412 2417516 120 01:32:01 AM 4811048 6950120 3071384 38.96 2688 2306284 770068 8.62 272412 2417896 36 01:33:01 AM 4810580 6950040 3071852 38.97 2688 2306672 770068 8.62 272412 2418268 192 01:34:01 AM 4810428 6950024 3072004 38.97 2688 2306800 770068 8.62 272412 2418480 28 01:35:01 AM 4810596 6950428 3071836 38.97 2688 2307044 770068 8.62 272412 2418512 24 01:36:01 AM 4810156 6950376 3072276 38.98 2688 2307432 770068 8.62 272412 2418900 208 01:37:01 AM 4809908 6950508 3072524 38.98 2688 2307812 770068 8.62 272412 2419448 24 01:38:01 AM 4809160 6950140 3073272 38.99 2688 2308192 770068 8.62 272412 2419896 84 01:39:01 AM 4808636 6950020 3073796 39.00 2688 2308584 769736 8.62 281756 2411056 380 01:40:01 AM 4807456 6949220 3074976 39.01 2688 2308964 773836 8.66 281756 2411972 24 01:41:01 AM 4807824 6950016 3074608 39.01 2688 2309388 773836 8.66 281756 2411896 216 01:42:01 AM 4807768 6950204 3074664 39.01 2688 2309632 773836 8.66 281756 2412088 64 01:43:01 AM 4807376 6950060 3075056 39.01 2688 2309888 773836 8.66 281756 2412268 248 01:44:01 AM 4806984 6950056 3075448 39.02 2688 2310268 773836 8.66 281756 2412588 160 01:45:01 AM 4806764 6950212 3075668 39.02 2688 2310652 773836 8.66 281756 2412964 148 01:46:01 AM 4806380 6950212 3076052 39.02 2688 2311036 773836 8.66 281756 2413464 68 01:47:01 AM 4805876 6950088 3076556 39.03 2688 2311416 773836 8.66 281756 2413844 220 01:48:02 AM 4805364 6949972 3077068 39.04 2688 2311812 773836 8.66 281756 2414308 160 01:49:01 AM 4804824 6950144 3077608 39.04 2688 2312516 773836 8.66 281756 2414836 184 01:50:01 AM 4804412 6949828 3078020 39.05 2688 2312612 769772 8.62 281756 2415284 8 01:51:01 AM 4804984 6950404 3077448 39.04 2688 2312616 769772 8.62 281756 2414944 4 01:52:01 AM 4804608 6950108 3077824 39.05 2688 2312696 769772 8.62 281756 2415024 4 01:53:01 AM 4804696 6950196 3077736 39.05 2688 2312696 769772 8.62 281756 2415092 4 01:54:01 AM 4804340 6949920 3078092 39.05 2688 2312776 769772 8.62 281756 2415224 84 01:55:01 AM 4804560 6950140 3077872 39.05 2688 2312776 769772 8.62 281756 2415108 4 01:56:01 AM 4804612 6950312 3077820 39.05 2688 2312896 769772 8.62 281756 2415224 128 01:57:01 AM 4804432 6950232 3078000 39.05 2688 2312996 769772 8.62 281756 2415340 4 01:58:01 AM 4804104 6949976 3078328 39.05 2688 2313068 769772 8.62 281756 2415592 4 01:59:01 AM 4803972 6949844 3078460 39.05 2688 2313068 769772 8.62 281756 2415644 4 02:00:01 AM 4803716 6949656 3078716 39.06 2688 2313136 769284 8.61 281756 2415944 72 02:01:01 AM 4802832 6949104 3079600 39.07 2688 2313468 769284 8.61 281756 2416496 52 02:02:01 AM 4803064 6949728 3079368 39.07 2688 2313868 769284 8.61 281760 2416736 224 02:03:01 AM 4802808 6949856 3079624 39.07 2688 2314248 769284 8.61 281760 2416780 68 02:04:01 AM 4802532 6949964 3079900 39.07 2688 2314632 769284 8.61 281760 2417208 224 02:05:01 AM 4802192 6950024 3080240 39.08 2688 2315024 769284 8.61 281760 2417612 60 02:06:01 AM 4801864 6950060 3080568 39.08 2688 2315396 769284 8.61 281760 2417856 176 02:07:01 AM 4801600 6950076 3080832 39.08 2688 2315668 769284 8.61 281760 2418136 32 02:08:01 AM 4801268 6949992 3081164 39.09 2688 2315916 769284 8.61 281760 2418440 244 02:09:01 AM 4801080 6950064 3081352 39.09 2688 2316184 769284 8.61 281760 2418772 116 02:10:01 AM 4800388 6949756 3082044 39.10 2688 2316568 769248 8.61 281760 2419272 72 02:11:01 AM 4800232 6950004 3082200 39.10 2688 2316968 769248 8.61 281760 2419596 148 02:12:01 AM 4799640 6949792 3082792 39.11 2688 2317348 769248 8.61 281760 2419976 132 02:13:01 AM 4799240 6949776 3083192 39.11 2688 2317732 769248 8.61 281760 2420432 84 02:14:01 AM 4798964 6949888 3083468 39.12 2688 2318120 769248 8.61 281760 2420752 240 02:15:01 AM 4798332 6949952 3084100 39.13 2688 2318816 769248 8.61 281760 2421408 452 02:16:01 AM 4798168 6949880 3084264 39.13 2688 2318900 769248 8.61 281760 2421504 4 02:17:01 AM 4798404 6950116 3084028 39.13 2688 2318900 769248 8.61 281760 2421388 4 02:18:01 AM 4798024 6949816 3084408 39.13 2688 2318980 769248 8.61 281760 2421536 4 02:19:01 AM 4798220 6950016 3084212 39.13 2688 2318984 769248 8.61 281760 2421476 4 02:20:01 AM 4797256 6949132 3085176 39.14 2688 2319064 761076 8.52 281760 2422136 88 02:21:01 AM 4797976 6949860 3084456 39.13 2688 2319072 761076 8.52 281760 2421720 4 02:22:01 AM 4797772 6949772 3084660 39.13 2688 2319212 761076 8.52 281760 2421840 148 02:23:01 AM 4797556 6949652 3084876 39.14 2688 2319284 761076 8.52 281760 2422012 48 02:24:01 AM 4797552 6949720 3084880 39.14 2688 2319356 761076 8.52 281760 2422060 4 02:25:01 AM 4797664 6949836 3084768 39.13 2688 2319360 761076 8.52 281760 2422024 4 02:26:01 AM 4797096 6949340 3085336 39.14 2688 2319432 761076 8.52 281760 2422540 80 02:27:01 AM 4797032 6949276 3085400 39.14 2688 2319432 761076 8.52 281760 2422540 4 02:28:01 AM 4796988 6949316 3085444 39.14 2688 2319516 761076 8.52 281760 2422580 88 02:29:01 AM 4797020 6949348 3085412 39.14 2688 2319516 761076 8.52 281760 2422512 4 02:30:01 AM 4796620 6949028 3085812 39.15 2688 2319596 777488 8.71 281760 2422836 88 02:31:01 AM 4796684 6949096 3085748 39.15 2688 2319600 777488 8.71 281760 2422888 4 02:32:01 AM 4796620 6949116 3085812 39.15 2688 2319684 777488 8.71 281760 2422972 92 02:33:01 AM 4796492 6948992 3085940 39.15 2688 2319688 777488 8.71 281760 2423072 16 02:34:01 AM 4796656 6949236 3085776 39.15 2688 2319768 777488 8.71 281760 2422868 92 02:35:01 AM 4796796 6949376 3085636 39.15 2688 2319768 777488 8.71 281760 2422784 4 02:36:01 AM 4796672 6949332 3085760 39.15 2688 2319848 777488 8.71 281760 2422856 84 02:37:01 AM 4796588 6949248 3085844 39.15 2688 2319848 777488 8.71 281760 2422864 8 02:38:01 AM 4796560 6949220 3085872 39.15 2688 2319848 777488 8.71 281760 2422932 4 02:39:01 AM 4796584 6949492 3085848 39.15 2688 2320104 777488 8.71 281768 2423096 172 02:40:01 AM 4795860 6949148 3086572 39.16 2688 2320484 777488 8.71 281768 2423824 68 02:41:01 AM 4795488 6949172 3086944 39.16 2688 2320868 777488 8.71 281768 2424016 144 02:42:01 AM 4794984 6949052 3087448 39.17 2688 2321252 777488 8.71 281768 2424520 4 02:43:01 AM 4794716 6949156 3087716 39.17 2688 2321632 777488 8.71 281768 2424844 160 02:44:01 AM 4794552 6949384 3087880 39.17 2688 2322016 777488 8.71 281768 2425024 20 02:45:01 AM 4794268 6949500 3088164 39.18 2688 2322416 777488 8.71 281768 2425428 4 02:46:01 AM 4794032 6949412 3088400 39.18 2688 2322564 777488 8.71 281768 2425700 4 02:47:01 AM 4793928 6949312 3088504 39.18 2688 2322568 777488 8.71 281768 2425704 4 02:48:01 AM 4793776 6949160 3088656 39.18 2688 2322568 777488 8.71 281768 2425864 4 02:49:01 AM 4794104 6949584 3088328 39.18 2688 2322664 777488 8.71 281768 2425688 4 02:50:01 AM 4793304 6948788 3089128 39.19 2688 2322668 769380 8.61 281768 2426236 16 02:51:01 AM 4793368 6948944 3089064 39.19 2688 2322760 769380 8.61 281768 2426304 12 02:52:01 AM 4793420 6949000 3089012 39.19 2688 2322764 769380 8.61 281768 2426336 4 02:53:01 AM 4793380 6949052 3089052 39.19 2688 2322856 769380 8.61 281768 2426228 4 02:54:01 AM 4793664 6949336 3088768 39.19 2688 2322856 769380 8.61 281768 2425984 4 02:55:01 AM 4793668 6949436 3088764 39.19 2688 2322952 769380 8.61 281768 2426084 4 02:56:01 AM 4793720 6949488 3088712 39.18 2688 2322952 769380 8.61 281768 2426084 4 02:57:01 AM 4793616 6949476 3088816 39.19 2688 2323044 769380 8.61 281768 2426180 4 02:58:01 AM 4793436 6949304 3088996 39.19 2688 2323052 769380 8.61 281768 2426372 4 02:59:02 AM 4793504 6949476 3088928 39.19 2688 2323156 769380 8.61 281768 2426284 116 03:00:01 AM 4792676 6949028 3089756 39.20 2688 2323548 772108 8.65 281768 2427016 116 03:01:01 AM 4791200 6947944 3091232 39.22 2688 2323932 772108 8.65 281768 2428152 68 03:02:01 AM 4791528 6948660 3090904 39.21 2688 2324312 772108 8.65 281768 2428052 20 03:03:01 AM 4791428 6948944 3091004 39.21 2688 2324696 772108 8.65 281768 2428156 4 03:04:01 AM 4791256 6949148 3091176 39.22 2688 2325080 772108 8.65 281768 2428464 192 03:05:01 AM 4790888 6949160 3091544 39.22 2688 2325460 772108 8.65 281768 2428844 112 03:06:01 AM 4790532 6949068 3091900 39.23 2688 2325732 772108 8.65 281768 2429224 120 03:07:01 AM 4790396 6948952 3092036 39.23 2688 2325736 772108 8.65 281768 2429136 4 03:08:01 AM 4790324 6948880 3092108 39.23 2688 2325736 772108 8.65 281768 2429340 4 03:09:01 AM 4789772 6948424 3092660 39.23 2688 2325828 768200 8.60 282520 2428928 256 03:10:01 AM 4789820 6948476 3092612 39.23 2688 2325832 769732 8.62 282520 2429052 4 03:11:01 AM 4790000 6948748 3092432 39.23 2688 2325924 769732 8.62 282520 2428796 4 03:12:01 AM 4790188 6948940 3092244 39.23 2688 2325928 769732 8.62 282520 2428800 4 03:13:01 AM 4790060 6948904 3092372 39.23 2688 2326020 769732 8.62 282520 2428756 4 03:14:01 AM 4790176 6949020 3092256 39.23 2688 2326020 769732 8.62 282520 2428688 4 03:15:01 AM 4790004 6948944 3092428 39.23 2688 2326116 769732 8.62 282520 2428784 4 03:16:01 AM 4790060 6949000 3092372 39.23 2688 2326116 769732 8.62 282520 2428784 4 03:17:01 AM 4790096 6949128 3092336 39.23 2688 2326208 769732 8.62 282520 2428876 4 03:18:01 AM 4790128 6949164 3092304 39.23 2688 2326212 785112 8.79 282520 2428948 4 03:19:01 AM 4789960 6949108 3092472 39.23 2688 2326324 785112 8.79 282520 2428984 16 03:20:01 AM 4789136 6948680 3093296 39.24 2688 2326728 805956 9.02 282520 2429728 24 03:21:01 AM 4789024 6948952 3093408 39.24 2688 2327112 776316 8.69 282520 2429980 36 03:22:01 AM 4788564 6948884 3093868 39.25 2688 2327496 776316 8.69 282520 2430204 100 03:23:01 AM 4787976 6948680 3094456 39.26 2688 2327880 776316 8.69 282520 2430796 24 03:24:01 AM 4788008 6949100 3094424 39.26 2688 2328276 776316 8.69 282520 2430980 220 03:25:01 AM 4787544 6949028 3094888 39.26 2688 2328660 776316 8.69 282520 2431372 148 03:26:01 AM 4787384 6949112 3095048 39.27 2688 2328904 776316 8.69 282520 2431624 116 03:27:01 AM 4787380 6949108 3095052 39.27 2688 2328904 776316 8.69 282520 2431624 8 03:28:01 AM 4787048 6948868 3095384 39.27 2688 2328996 776316 8.69 282520 2432040 108 03:29:01 AM 4787172 6948996 3095260 39.27 2688 2329000 776316 8.69 282520 2431740 8 03:30:01 AM 4786812 6948636 3095620 39.27 2688 2329000 778120 8.71 282520 2432104 8 03:31:01 AM 4786896 6948824 3095536 39.27 2688 2329100 778120 8.71 282520 2432008 4 03:32:01 AM 4787248 6949176 3095184 39.27 2688 2329100 778120 8.71 282520 2431860 4 03:33:01 AM 4786668 6948688 3095764 39.27 2688 2329192 778120 8.71 282520 2432232 4 03:34:01 AM 4786820 6948844 3095612 39.27 2688 2329196 778120 8.71 282520 2432012 4 03:35:01 AM 4786772 6948888 3095660 39.27 2688 2329288 778120 8.71 282520 2432056 4 03:36:01 AM 4786884 6949000 3095548 39.27 2688 2329288 778120 8.71 282520 2432056 4 03:37:01 AM 4786840 6949048 3095592 39.27 2688 2329380 778120 8.71 282520 2432248 4 03:38:01 AM 4786728 6948944 3095704 39.27 2688 2329388 778120 8.71 282520 2432192 4 03:39:01 AM 4786564 6949024 3095868 39.28 2688 2329632 778120 8.71 282520 2432392 4 03:40:01 AM 4785488 6948268 3096944 39.29 2688 2329960 794652 8.90 282520 2433180 176 03:41:01 AM 4785768 6948932 3096664 39.29 2688 2330344 794652 8.90 282520 2433100 160 03:42:01 AM 4785620 6949164 3096812 39.29 2688 2330724 794652 8.90 282520 2433480 4 03:43:01 AM 4784804 6948736 3097628 39.30 2688 2331112 794652 8.90 282520 2434052 0 03:44:01 AM 4784496 6948816 3097936 39.30 2688 2331492 794652 8.90 282520 2434268 24 03:45:01 AM 4784272 6948980 3098160 39.30 2688 2331888 794652 8.90 282520 2434644 24 03:46:01 AM 4783392 6948752 3099040 39.32 2688 2332540 779084 8.72 282520 2435412 4 03:47:01 AM 4783404 6948840 3099028 39.32 2688 2332608 779084 8.72 282520 2435376 4 03:48:01 AM 4783344 6948780 3099088 39.32 2688 2332608 779084 8.72 282520 2435444 4 03:49:01 AM 4783412 6948932 3099020 39.32 2688 2332692 779084 8.72 282520 2435460 4 03:50:01 AM 4782128 6947724 3100304 39.33 2688 2332692 779084 8.72 282520 2436344 4 03:51:01 AM 4782568 6948268 3099864 39.33 2688 2332780 779084 8.72 282520 2435932 4 03:52:01 AM 4782736 6948436 3099696 39.32 2688 2332780 779084 8.72 282520 2435932 4 03:53:01 AM 4782552 6948424 3099880 39.33 2688 2332952 779084 8.72 282520 2436180 164 03:54:01 AM 4782428 6948352 3100004 39.33 2688 2333004 778936 8.72 282520 2436172 16 03:55:01 AM 4782260 6948248 3100172 39.33 2688 2333068 778936 8.72 282520 2436348 4 03:56:01 AM 4782332 6948320 3100100 39.33 2688 2333068 778936 8.72 282520 2436232 4 03:57:01 AM 4782080 6948136 3100352 39.33 2688 2333136 778936 8.72 282520 2436412 4 03:58:01 AM 4782120 6948592 3100312 39.33 2688 2333560 778936 8.72 282520 2436772 160 03:59:01 AM 4781636 6948492 3100796 39.34 2688 2333940 778936 8.72 282520 2437088 128 04:00:01 AM 4780852 6948096 3101580 39.35 2688 2334328 775680 8.69 282520 2437824 116 04:01:01 AM 4779768 6947396 3102664 39.36 2688 2334708 775680 8.69 282520 2438552 40 04:02:01 AM 4779876 6947904 3102556 39.36 2688 2335108 775680 8.69 282520 2438560 204 04:03:01 AM 4780044 6948452 3102388 39.36 2688 2335488 775680 8.69 282520 2438732 160 04:04:01 AM 4779924 6948512 3102508 39.36 2688 2335660 775680 8.69 282520 2438876 16 04:05:01 AM 4779572 6948324 3102860 39.36 2688 2335824 775680 8.69 282520 2439052 72 04:06:01 AM 4779004 6948168 3103428 39.37 2688 2336236 775680 8.69 282520 2439568 24 04:07:01 AM 4778768 6948328 3103664 39.37 2688 2336632 775680 8.69 282520 2440032 24 04:08:01 AM 4777524 6947460 3104908 39.39 2688 2337016 775680 8.69 282520 2441048 4 04:09:02 AM 4777396 6947720 3105036 39.39 2688 2337400 775680 8.69 282520 2441364 40 04:10:01 AM 4776028 6946724 3106404 39.41 2688 2337764 771064 8.63 282520 2442628 4 04:11:01 AM 4775768 6946844 3106664 39.41 2688 2338148 771064 8.63 282520 2442920 36 04:12:01 AM 4775500 6946872 3106932 39.42 2688 2338436 771064 8.63 282520 2443204 4 04:13:01 AM 4775188 6946800 3107244 39.42 2688 2338676 771064 8.63 282520 2443524 24 04:14:01 AM 4774736 6946720 3107696 39.43 2688 2339056 771064 8.63 282520 2443816 68 04:15:01 AM 4774484 6946868 3107948 39.43 2688 2339456 771064 8.63 282520 2444076 240 04:16:01 AM 4774192 6946956 3108240 39.43 2688 2339836 771064 8.63 282520 2444452 160 04:17:01 AM 4773328 6946496 3109104 39.44 2688 2340232 770736 8.63 283360 2444284 340 04:18:01 AM 4773032 6946592 3109400 39.45 2688 2340616 770736 8.63 283360 2444628 4 04:19:01 AM 4772396 6946716 3110036 39.46 2688 2341376 770736 8.63 283360 2445320 48 04:20:01 AM 4772140 6946560 3110292 39.46 2688 2341476 762888 8.54 283360 2445500 4 04:21:01 AM 4772208 6946628 3110224 39.46 2688 2341476 762888 8.54 283360 2445396 4 04:22:01 AM 4772212 6946716 3110220 39.46 2688 2341560 762888 8.54 283360 2445600 4 04:23:01 AM 4772164 6946668 3110268 39.46 2688 2341560 762888 8.54 283360 2445560 4 04:24:01 AM 4772404 6946988 3110028 39.46 2688 2341640 762888 8.54 283360 2445440 92 04:25:01 AM 4772492 6947080 3109940 39.45 2688 2341644 762888 8.54 283360 2445448 4 04:26:01 AM 4772356 6946944 3110076 39.46 2688 2341644 762888 8.54 283360 2445448 4 04:27:01 AM 4772004 6946772 3110428 39.46 2688 2341832 782988 8.77 283360 2445640 24 04:28:01 AM 4771844 6946808 3110588 39.46 2688 2342020 782988 8.77 283368 2445900 4 04:29:01 AM 4771968 6946932 3110464 39.46 2688 2342020 782988 8.77 283368 2445832 4 04:30:01 AM 4771180 6946184 3111252 39.47 2688 2342060 780260 8.74 283368 2446220 4 04:31:01 AM 4771536 6946608 3110896 39.47 2688 2342124 780260 8.74 283368 2446088 12 04:32:01 AM 4771324 6946492 3111108 39.47 2688 2342220 780260 8.74 283368 2446184 4 04:33:01 AM 4770928 6946164 3111504 39.47 2688 2342288 780260 8.74 283368 2446500 16 04:34:01 AM 4771212 6946588 3111220 39.47 2688 2342428 780260 8.74 283372 2446284 12 04:35:01 AM 4771292 6946668 3111140 39.47 2688 2342428 780260 8.74 283372 2446284 4 04:36:01 AM 4771224 6946748 3111208 39.47 2688 2342576 780260 8.74 283372 2446432 16 04:37:01 AM 4770792 6946716 3111640 39.48 2688 2342984 780260 8.74 283372 2446828 68 04:38:01 AM 4768900 6945204 3113532 39.50 2688 2343364 780260 8.74 283372 2448756 24 04:39:01 AM 4768992 6945684 3113440 39.50 2688 2343752 780260 8.74 283372 2448756 4 04:40:01 AM 4766992 6944072 3115440 39.52 2688 2344132 780260 8.74 283372 2450672 40 04:41:01 AM 4767196 6944672 3115236 39.52 2688 2344532 780260 8.74 283372 2450472 40 04:42:01 AM 4766300 6944164 3116132 39.53 2688 2344912 795940 8.91 283372 2451188 188 04:43:01 AM 4766164 6944632 3116268 39.53 2688 2345512 795940 8.91 283372 2451532 32 04:44:01 AM 4766500 6945044 3115932 39.53 2688 2345588 795940 8.91 283372 2451400 4 04:45:01 AM 4766132 6944676 3116300 39.53 2688 2345588 795940 8.91 283372 2451400 4 04:46:01 AM 4765956 6944580 3116476 39.54 2688 2345668 795940 8.91 283372 2451688 4 04:47:01 AM 4765780 6944408 3116652 39.54 2688 2345672 795940 8.91 283380 2451856 4 04:48:01 AM 4765944 6944652 3116488 39.54 2688 2345752 795940 8.91 283372 2451724 8 04:49:01 AM 4766060 6944768 3116372 39.54 2688 2345752 780128 8.74 283372 2451672 4 04:50:01 AM 4765492 6944376 3116940 39.54 2688 2345928 782064 8.76 283372 2451972 180 04:51:01 AM 4765484 6944428 3116948 39.54 2688 2345988 782064 8.76 283372 2451964 16 04:52:01 AM 4765444 6944536 3116988 39.54 2688 2346132 782064 8.76 283372 2452224 4 04:53:01 AM 4765304 6944400 3117128 39.55 2688 2346136 782064 8.76 283372 2452028 4 04:54:01 AM 4765672 6944880 3116760 39.54 2688 2346248 782064 8.76 283388 2452140 4 04:55:01 AM 4764924 6944192 3117508 39.55 2688 2346308 782064 8.76 283388 2452456 16 04:56:01 AM 4765328 6944664 3117104 39.54 2688 2346376 782064 8.76 283388 2452184 24 04:57:01 AM 4765236 6944756 3117196 39.55 2688 2346560 782064 8.76 283388 2452368 4 04:58:01 AM 4765060 6944580 3117372 39.55 2688 2346560 782064 8.76 283388 2452564 16 04:59:01 AM 4765008 6944668 3117424 39.55 2688 2346700 782064 8.76 283388 2452500 148 05:00:01 AM 4762776 6942632 3119656 39.58 2688 2346904 787796 8.82 283388 2454760 56 05:01:01 AM 4761592 6941840 3120840 39.59 2688 2347288 787796 8.82 283388 2455876 172 05:02:01 AM 4761516 6942152 3120916 39.59 2688 2347676 787796 8.82 283400 2455832 160 05:03:01 AM 4761312 6942352 3121120 39.60 2688 2348072 787796 8.82 283400 2456112 40 05:04:01 AM 4761340 6942756 3121092 39.60 2688 2348456 787796 8.82 283400 2456304 144 05:05:01 AM 4761032 6942832 3121400 39.60 2688 2348840 787796 8.82 283400 2456688 100 05:06:01 AM 4760152 6942700 3122280 39.61 2688 2349596 787796 8.82 283400 2457552 540 05:07:01 AM 4759952 6942728 3122480 39.61 2688 2349816 787796 8.82 283400 2457664 104 05:08:01 AM 4759448 6942512 3122984 39.62 2688 2350104 787796 8.82 283400 2458088 56 05:09:01 AM 4759156 6942504 3123276 39.62 2688 2350388 787796 8.82 283400 2458352 52 05:10:01 AM 4758660 6942260 3123772 39.63 2688 2350632 779604 8.73 283400 2458836 4 05:11:01 AM 4758724 6942604 3123708 39.63 2688 2350920 779604 8.73 283400 2458920 4 05:12:01 AM 4758176 6942344 3124256 39.64 2688 2351208 779604 8.73 283400 2459208 4 05:13:01 AM 4760060 6944500 3122372 39.61 2688 2351472 780360 8.74 283400 2457352 56 05:14:01 AM 4760088 6944680 3122344 39.61 2688 2351624 780360 8.74 283404 2457432 16 05:15:01 AM 4760116 6944720 3122316 39.61 2688 2351636 780360 8.74 283404 2457444 4 05:16:01 AM 4759992 6944792 3122440 39.61 2688 2351832 780360 8.74 283408 2457624 156 05:17:01 AM 4757596 6942600 3124836 39.64 2688 2352036 780360 8.74 283408 2459888 136 05:18:02 AM 4757208 6942596 3125224 39.65 2688 2352428 780360 8.74 283408 2460344 148 05:19:01 AM 4756612 6942384 3125820 39.66 2688 2352808 795736 8.91 283408 2460864 68 05:20:01 AM 4755972 6942124 3126460 39.66 2688 2353188 789324 8.84 283408 2461384 220 05:21:01 AM 4755796 6942340 3126636 39.67 2688 2353580 789324 8.84 283408 2461588 148 05:22:01 AM 4754924 6941848 3127508 39.68 2688 2353960 789324 8.84 283408 2462496 128 05:23:01 AM 4755236 6942552 3127196 39.67 2688 2354344 789324 8.84 283408 2462356 164 05:24:01 AM 4754640 6942588 3127792 39.68 2688 2354976 789324 8.84 283408 2462836 4 05:25:01 AM 4754284 6942508 3128148 39.69 2688 2355260 789324 8.84 283408 2463228 56 05:26:01 AM 4754172 6942688 3128260 39.69 2688 2355552 789324 8.84 283408 2463520 152 05:27:01 AM 4753928 6942732 3128504 39.69 2688 2355836 789324 8.84 283408 2463688 56 05:28:01 AM 4753568 6942660 3128864 39.69 2688 2356124 789324 8.84 283408 2464044 104 05:29:01 AM 4753432 6942820 3129000 39.70 2688 2356412 789324 8.84 283408 2464272 84 05:30:01 AM 4754636 6944288 3127796 39.68 2688 2356676 771680 8.64 283408 2462728 16 05:31:01 AM 4752236 6942188 3130196 39.71 2688 2356976 794552 8.90 283412 2465080 4 05:32:01 AM 4748748 6939244 3133684 39.76 2688 2357512 830604 9.30 283412 2467984 256 05:33:01 AM 4748128 6938900 3134304 39.76 2688 2357796 865028 9.69 283412 2468644 252 05:34:01 AM 4747604 6938772 3134828 39.77 2688 2358184 897020 10.04 283412 2468948 8 05:35:01 AM 4745252 6936716 3137180 39.80 2688 2358480 912404 10.22 283412 2471376 40 05:36:01 AM 4744596 6936356 3137836 39.81 2688 2358768 929712 10.41 283412 2471748 4 05:37:01 AM 4823256 6916136 3059176 38.81 2688 2263700 741196 8.30 346096 2347508 96608 05:38:01 AM 4824052 6916144 3058380 38.80 2688 2264760 731268 8.19 548488 2152420 11196 Average: 4794333 6948145 3088099 39.18 2688 2320993 778226 8.71 280418 2426644 379 12:00:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 12:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:01:01 AM eth0 12.53 9.33 3.01 1.82 0.00 0.00 0.00 0.00 12:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:02:01 AM eth0 14.77 11.54 3.84 2.61 0.00 0.00 0.00 0.00 12:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:03:01 AM eth0 11.76 8.75 2.81 1.62 0.00 0.00 0.00 0.00 12:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:04:01 AM eth0 0.93 0.10 0.05 0.01 0.00 0.00 0.00 0.00 12:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:05:01 AM eth0 0.80 0.40 0.10 0.05 0.00 0.00 0.00 0.00 12:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:06:01 AM eth0 1.25 0.12 0.20 0.04 0.00 0.00 0.00 0.00 12:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:07:01 AM eth0 2.12 0.23 0.47 0.20 0.00 0.00 0.00 0.00 12:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:08:01 AM eth0 2.05 0.67 0.61 0.34 0.00 0.00 0.00 0.00 12:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:09:01 AM eth0 0.58 0.20 0.27 0.20 0.00 0.00 0.00 0.00 12:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:10:01 AM eth0 11.98 10.00 2.04 1.14 0.00 0.00 0.00 0.00 12:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:11:01 AM eth0 10.81 8.68 1.45 0.65 0.00 0.00 0.00 0.00 12:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:12:01 AM eth0 2.88 0.65 0.34 0.10 0.00 0.00 0.00 0.00 12:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:13:01 AM eth0 0.93 0.22 0.24 0.07 0.00 0.00 0.00 0.00 12:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:14:01 AM eth0 5.21 4.53 0.68 0.32 0.00 0.00 0.00 0.00 12:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:15:01 AM eth0 0.88 0.53 0.14 0.09 0.00 0.00 0.00 0.00 12:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:16:01 AM eth0 0.72 0.03 0.04 0.00 0.00 0.00 0.00 0.00 12:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:17:01 AM eth0 5.38 4.88 0.71 0.39 0.00 0.00 0.00 0.00 12:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:18:01 AM eth0 1.67 0.57 0.58 0.32 0.00 0.00 0.00 0.00 12:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:19:01 AM eth0 0.55 0.07 0.03 0.00 0.00 0.00 0.00 0.00 12:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:20:01 AM eth0 6.80 5.38 1.01 0.43 0.00 0.00 0.00 0.00 12:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:21:01 AM eth0 0.27 0.00 0.02 0.00 0.00 0.00 0.00 0.00 12:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:22:01 AM eth0 5.78 5.05 0.80 0.35 0.00 0.00 0.00 0.00 12:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:23:01 AM eth0 1.03 0.67 0.27 0.16 0.00 0.00 0.00 0.00 12:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:24:01 AM eth0 0.82 0.07 0.09 0.00 0.00 0.00 0.00 0.00 12:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:25:01 AM eth0 5.80 4.82 1.04 0.55 0.00 0.00 0.00 0.00 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:26:01 AM eth0 1.83 0.67 0.43 0.28 0.00 0.00 0.00 0.00 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:27:01 AM eth0 3.50 0.07 0.27 0.00 0.00 0.00 0.00 0.00 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:28:01 AM eth0 8.05 4.95 1.32 0.63 0.00 0.00 0.00 0.00 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:29:01 AM eth0 4.60 0.43 0.68 0.22 0.00 0.00 0.00 0.00 12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:30:01 AM eth0 4.00 0.40 0.65 0.39 0.00 0.00 0.00 0.00 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:31:01 AM eth0 7.66 4.80 1.10 0.40 0.00 0.00 0.00 0.00 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:32:01 AM eth0 2.82 0.17 0.29 0.01 0.00 0.00 0.00 0.00 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:33:01 AM eth0 1.87 0.55 0.76 0.49 0.00 0.00 0.00 0.00 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:34:01 AM eth0 0.75 0.13 0.04 0.01 0.00 0.00 0.00 0.00 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:35:01 AM eth0 0.55 0.05 0.09 0.00 0.00 0.00 0.00 0.00 12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:36:01 AM eth0 1.53 0.23 0.41 0.20 0.00 0.00 0.00 0.00 12:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:37:01 AM eth0 0.38 0.10 0.03 0.00 0.00 0.00 0.00 0.00 12:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:38:01 AM eth0 1.75 0.15 0.18 0.07 0.00 0.00 0.00 0.00 12:39:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:39:02 AM eth0 13.63 9.60 2.53 1.37 0.00 0.00 0.00 0.00 12:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:40:01 AM eth0 12.03 9.54 2.87 1.85 0.00 0.00 0.00 0.00 12:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:41:01 AM eth0 10.55 8.95 2.65 1.78 0.00 0.00 0.00 0.00 12:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:42:01 AM eth0 11.66 9.13 3.02 1.97 0.00 0.00 0.00 0.00 12:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:43:01 AM eth0 10.98 9.06 2.84 1.85 0.00 0.00 0.00 0.00 12:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:44:01 AM eth0 12.10 9.15 2.87 1.80 0.00 0.00 0.00 0.00 12:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:45:01 AM eth0 12.18 9.63 3.44 2.25 0.00 0.00 0.00 0.00 12:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:46:01 AM eth0 17.46 14.20 4.39 2.69 0.00 0.00 0.00 0.00 12:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:47:01 AM eth0 2.45 0.27 0.32 0.04 0.00 0.00 0.00 0.00 12:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:48:01 AM eth0 2.12 0.32 0.57 0.29 0.00 0.00 0.00 0.00 12:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:49:01 AM eth0 0.65 0.38 0.09 0.05 0.00 0.00 0.00 0.00 12:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:50:01 AM eth0 3.17 0.07 0.43 0.00 0.00 0.00 0.00 0.00 12:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:51:01 AM eth0 0.97 0.30 0.15 0.04 0.00 0.00 0.00 0.00 12:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:52:01 AM eth0 0.62 0.00 0.04 0.00 0.00 0.00 0.00 0.00 12:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:53:01 AM eth0 10.41 9.65 1.91 1.13 0.00 0.00 0.00 0.00 12:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:54:01 AM eth0 5.07 4.60 0.68 0.35 0.00 0.00 0.00 0.00 12:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:55:01 AM eth0 1.73 0.58 0.21 0.09 0.00 0.00 0.00 0.00 12:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:56:01 AM eth0 1.25 0.10 0.09 0.00 0.00 0.00 0.00 0.00 12:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:57:01 AM eth0 2.30 0.05 0.25 0.00 0.00 0.00 0.00 0.00 12:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:58:01 AM eth0 2.45 1.28 1.02 9.33 0.00 0.00 0.00 0.00 12:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 12:59:01 AM eth0 5.00 4.10 0.76 0.33 0.00 0.00 0.00 0.00 01:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:00:01 AM eth0 15.69 10.58 3.66 2.08 0.00 0.00 0.00 0.00 01:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:01:01 AM eth0 11.21 8.95 2.76 1.78 0.00 0.00 0.00 0.00 01:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:02:01 AM eth0 11.76 9.23 3.04 1.98 0.00 0.00 0.00 0.00 01:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:03:01 AM eth0 11.15 9.13 2.90 1.85 0.00 0.00 0.00 0.00 01:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:04:01 AM eth0 11.81 9.11 2.83 1.82 0.00 0.00 0.00 0.00 01:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:05:01 AM eth0 11.35 9.30 3.03 2.02 0.00 0.00 0.00 0.00 01:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:06:01 AM eth0 3.65 2.25 0.76 0.43 0.00 0.00 0.00 0.00 01:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:07:01 AM eth0 3.87 0.33 0.31 0.06 0.00 0.00 0.00 0.00 01:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:08:01 AM eth0 3.75 0.52 0.99 0.51 0.00 0.00 0.00 0.00 01:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:09:01 AM eth0 3.32 2.03 0.84 0.57 0.00 0.00 0.00 0.00 01:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:10:01 AM eth0 13.46 9.32 3.21 1.98 0.00 0.00 0.00 0.00 01:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:11:01 AM eth0 11.23 8.98 2.78 1.79 0.00 0.00 0.00 0.00 01:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:12:01 AM eth0 11.50 9.00 2.83 1.79 0.00 0.00 0.00 0.00 01:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:13:01 AM eth0 11.73 9.20 2.96 1.86 0.00 0.00 0.00 0.00 01:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:14:01 AM eth0 11.61 9.22 2.88 1.80 0.00 0.00 0.00 0.00 01:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:15:01 AM eth0 10.91 9.00 2.73 1.79 0.00 0.00 0.00 0.00 01:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:16:01 AM eth0 18.15 13.93 4.52 2.82 0.00 0.00 0.00 0.00 01:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:17:01 AM eth0 5.28 0.03 0.31 0.00 0.00 0.00 0.00 0.00 01:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:18:01 AM eth0 4.07 0.30 0.69 0.29 0.00 0.00 0.00 0.00 01:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:19:01 AM eth0 1.75 0.58 0.68 0.42 0.00 0.00 0.00 0.00 01:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:20:01 AM eth0 2.35 0.23 0.49 0.19 0.00 0.00 0.00 0.00 01:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:21:01 AM eth0 4.62 0.32 0.70 0.04 0.00 0.00 0.00 0.00 01:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:22:01 AM eth0 2.43 0.15 0.45 0.19 0.00 0.00 0.00 0.00 01:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:23:01 AM eth0 10.51 9.30 2.01 1.11 0.00 0.00 0.00 0.00 01:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:24:01 AM eth0 5.48 4.87 0.72 0.37 0.00 0.00 0.00 0.00 01:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:25:01 AM eth0 1.18 0.57 0.16 0.09 0.00 0.00 0.00 0.00 01:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:26:01 AM eth0 1.17 0.10 0.15 0.00 0.00 0.00 0.00 0.00 01:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:27:01 AM eth0 6.38 5.56 1.09 0.59 0.00 0.00 0.00 0.00 01:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:28:01 AM eth0 12.30 9.85 3.21 1.98 0.00 0.00 0.00 0.00 01:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:29:01 AM eth0 11.50 9.40 2.89 1.86 0.00 0.00 0.00 0.00 01:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:30:01 AM eth0 11.26 9.03 2.75 1.79 0.00 0.00 0.00 0.00 01:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:31:01 AM eth0 11.45 9.15 2.82 1.80 0.00 0.00 0.00 0.00 01:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:32:01 AM eth0 11.83 9.13 2.84 1.80 0.00 0.00 0.00 0.00 01:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:33:01 AM eth0 12.45 9.45 3.35 2.06 0.00 0.00 0.00 0.00 01:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:34:01 AM eth0 4.02 2.23 0.99 0.58 0.00 0.00 0.00 0.00 01:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:35:01 AM eth0 4.27 3.85 1.02 0.75 0.00 0.00 0.00 0.00 01:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:36:01 AM eth0 10.98 9.03 2.73 1.79 0.00 0.00 0.00 0.00 01:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:37:01 AM eth0 11.05 9.08 2.76 1.79 0.00 0.00 0.00 0.00 01:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:38:01 AM eth0 11.45 9.33 2.88 1.87 0.00 0.00 0.00 0.00 01:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:39:01 AM eth0 11.81 9.16 2.99 1.80 0.00 0.00 0.00 0.00 01:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:40:01 AM eth0 11.66 9.42 3.14 2.03 0.00 0.00 0.00 0.00 01:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:41:01 AM eth0 10.90 8.67 2.64 1.70 0.00 0.00 0.00 0.00 01:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:42:01 AM eth0 3.15 2.38 0.81 0.64 0.00 0.00 0.00 0.00 01:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:43:01 AM eth0 7.23 6.03 1.87 1.22 0.00 0.00 0.00 0.00 01:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:44:01 AM eth0 10.85 8.96 2.72 1.79 0.00 0.00 0.00 0.00 01:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:45:01 AM eth0 11.31 9.03 2.84 1.79 0.00 0.00 0.00 0.00 01:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:46:01 AM eth0 10.91 8.91 2.75 1.78 0.00 0.00 0.00 0.00 01:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:47:01 AM eth0 11.31 9.38 2.87 1.86 0.00 0.00 0.00 0.00 01:48:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:48:02 AM eth0 11.30 9.27 2.92 1.87 0.00 0.00 0.00 0.00 01:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:49:01 AM eth0 19.98 16.88 5.16 3.22 0.00 0.00 0.00 0.00 01:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:50:01 AM eth0 0.75 0.38 0.11 0.05 0.00 0.00 0.00 0.00 01:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:51:01 AM eth0 0.18 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:52:01 AM eth0 0.80 0.28 0.14 0.04 0.00 0.00 0.00 0.00 01:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:53:01 AM eth0 0.45 0.10 0.15 0.06 0.00 0.00 0.00 0.00 01:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:54:01 AM eth0 0.53 0.33 0.09 0.05 0.00 0.00 0.00 0.00 01:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:55:01 AM eth0 0.17 0.00 0.01 0.00 0.00 0.00 0.00 0.00 01:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:56:01 AM eth0 3.42 2.72 0.79 0.53 0.00 0.00 0.00 0.00 01:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:57:01 AM eth0 11.30 11.36 1.64 0.88 0.00 0.00 0.00 0.00 01:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:58:01 AM eth0 0.98 0.68 0.27 0.16 0.00 0.00 0.00 0.00 01:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 01:59:01 AM eth0 0.52 0.10 0.10 0.00 0.00 0.00 0.00 0.00 02:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:00:01 AM eth0 3.83 3.63 0.52 0.26 0.00 0.00 0.00 0.00 02:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:01:01 AM eth0 10.01 8.47 2.53 1.65 0.00 0.00 0.00 0.00 02:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:02:01 AM eth0 11.41 9.33 3.02 1.99 0.00 0.00 0.00 0.00 02:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:03:01 AM eth0 10.91 9.07 2.85 1.85 0.00 0.00 0.00 0.00 02:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:04:01 AM eth0 10.95 9.00 2.77 1.79 0.00 0.00 0.00 0.00 02:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:05:01 AM eth0 11.10 9.22 2.84 1.85 0.00 0.00 0.00 0.00 02:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:06:01 AM eth0 10.65 8.90 2.69 1.78 0.00 0.00 0.00 0.00 02:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:07:01 AM eth0 5.88 4.88 1.46 0.96 0.00 0.00 0.00 0.00 02:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:08:01 AM eth0 2.67 2.23 0.61 0.46 0.00 0.00 0.00 0.00 02:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:09:01 AM eth0 7.38 6.42 1.85 1.27 0.00 0.00 0.00 0.00 02:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:10:01 AM eth0 11.10 9.06 2.78 1.80 0.00 0.00 0.00 0.00 02:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:11:01 AM eth0 10.68 8.98 2.75 1.79 0.00 0.00 0.00 0.00 02:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:12:01 AM eth0 11.03 9.00 2.84 1.79 0.00 0.00 0.00 0.00 02:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:13:01 AM eth0 10.93 9.18 2.85 1.86 0.00 0.00 0.00 0.00 02:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:14:01 AM eth0 10.88 8.97 2.74 1.79 0.00 0.00 0.00 0.00 02:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:15:01 AM eth0 18.66 15.93 4.86 3.06 0.00 0.00 0.00 0.00 02:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:16:01 AM eth0 0.55 0.37 0.09 0.05 0.00 0.00 0.00 0.00 02:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:17:01 AM eth0 0.10 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:18:01 AM eth0 0.77 0.48 0.21 0.11 0.00 0.00 0.00 0.00 02:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:19:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:20:01 AM eth0 0.55 0.37 0.12 0.05 0.00 0.00 0.00 0.00 02:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:21:01 AM eth0 0.13 0.00 0.02 0.00 0.00 0.00 0.00 0.00 02:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:22:01 AM eth0 3.95 3.33 0.94 0.65 0.00 0.00 0.00 0.00 02:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:23:01 AM eth0 11.15 11.06 1.69 0.84 0.00 0.00 0.00 0.00 02:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:24:01 AM eth0 0.75 0.63 0.14 0.10 0.00 0.00 0.00 0.00 02:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:25:01 AM eth0 0.25 0.17 0.02 0.01 0.00 0.00 0.00 0.00 02:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:26:01 AM eth0 0.42 0.22 0.08 0.03 0.00 0.00 0.00 0.00 02:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:27:01 AM eth0 0.13 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:28:01 AM eth0 0.58 0.33 0.16 0.09 0.00 0.00 0.00 0.00 02:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:29:01 AM eth0 0.20 0.05 0.07 0.00 0.00 0.00 0.00 0.00 02:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:30:01 AM eth0 0.47 0.27 0.09 0.03 0.00 0.00 0.00 0.00 02:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:31:01 AM eth0 0.08 0.00 0.01 0.00 0.00 0.00 0.00 0.00 02:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:32:01 AM eth0 0.57 0.27 0.11 0.03 0.00 0.00 0.00 0.00 02:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:33:01 AM eth0 1.18 0.25 0.41 0.25 0.00 0.00 0.00 0.00 02:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:34:01 AM eth0 0.42 0.27 0.08 0.03 0.00 0.00 0.00 0.00 02:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:35:01 AM eth0 0.38 0.12 0.13 0.01 0.00 0.00 0.00 0.00 02:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:36:01 AM eth0 0.33 0.17 0.08 0.03 0.00 0.00 0.00 0.00 02:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:37:01 AM eth0 0.25 0.08 0.02 0.00 0.00 0.00 0.00 0.00 02:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:38:01 AM eth0 0.30 0.18 0.09 0.07 0.00 0.00 0.00 0.00 02:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:39:01 AM eth0 8.32 7.82 1.67 1.07 0.00 0.00 0.00 0.00 02:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:40:01 AM eth0 10.38 8.93 2.72 1.78 0.00 0.00 0.00 0.00 02:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:41:01 AM eth0 10.80 9.03 2.74 1.79 0.00 0.00 0.00 0.00 02:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:42:01 AM eth0 10.50 9.05 2.68 1.79 0.00 0.00 0.00 0.00 02:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:43:01 AM eth0 10.86 9.07 2.84 1.85 0.00 0.00 0.00 0.00 02:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:44:01 AM eth0 11.30 9.15 2.83 1.84 0.00 0.00 0.00 0.00 02:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:45:01 AM eth0 10.73 8.82 2.71 1.76 0.00 0.00 0.00 0.00 02:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:46:01 AM eth0 0.65 0.57 0.07 0.08 0.00 0.00 0.00 0.00 02:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:47:01 AM eth0 0.53 0.05 0.06 0.00 0.00 0.00 0.00 0.00 02:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:48:01 AM eth0 1.17 0.30 0.49 0.29 0.00 0.00 0.00 0.00 02:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:49:01 AM eth0 0.25 0.18 0.02 0.02 0.00 0.00 0.00 0.00 02:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:50:01 AM eth0 5.08 0.28 0.80 0.23 0.00 0.00 0.00 0.00 02:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:51:01 AM eth0 6.03 1.17 2.01 1.20 0.00 0.00 0.00 0.00 02:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:52:01 AM eth0 1.57 0.33 0.62 0.38 0.00 0.00 0.00 0.00 02:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:53:01 AM eth0 3.60 0.37 0.57 0.09 0.00 0.00 0.00 0.00 02:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:54:01 AM eth0 5.38 0.00 0.68 0.00 0.00 0.00 0.00 0.00 02:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:55:01 AM eth0 1.03 0.17 0.07 0.01 0.00 0.00 0.00 0.00 02:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:56:01 AM eth0 0.63 0.00 0.04 0.00 0.00 0.00 0.00 0.00 02:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:57:01 AM eth0 0.67 0.18 0.04 0.02 0.00 0.00 0.00 0.00 02:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:58:01 AM eth0 1.35 0.20 0.22 0.07 0.00 0.00 0.00 0.00 02:59:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 02:59:02 AM eth0 2.32 0.62 0.20 0.13 0.00 0.00 0.00 0.00 03:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:00:01 AM eth0 11.73 9.34 2.82 1.83 0.00 0.00 0.00 0.00 03:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:01:01 AM eth0 11.93 9.01 2.80 1.79 0.00 0.00 0.00 0.00 03:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:02:01 AM eth0 12.58 9.28 3.10 1.99 0.00 0.00 0.00 0.00 03:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:03:01 AM eth0 11.31 9.03 2.89 1.85 0.00 0.00 0.00 0.00 03:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:04:01 AM eth0 10.90 9.03 2.73 1.79 0.00 0.00 0.00 0.00 03:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:05:01 AM eth0 10.95 9.01 2.74 1.79 0.00 0.00 0.00 0.00 03:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:06:01 AM eth0 3.77 3.12 0.84 0.60 0.00 0.00 0.00 0.00 03:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:07:01 AM eth0 0.82 0.05 0.08 0.00 0.00 0.00 0.00 0.00 03:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:08:01 AM eth0 3.60 0.38 0.73 0.30 0.00 0.00 0.00 0.00 03:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:09:01 AM eth0 2.55 0.63 0.75 0.44 0.00 0.00 0.00 0.00 03:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:10:01 AM eth0 1.92 0.15 0.45 0.19 0.00 0.00 0.00 0.00 03:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:11:01 AM eth0 4.75 0.20 0.61 0.02 0.00 0.00 0.00 0.00 03:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:12:01 AM eth0 1.38 0.00 0.11 0.00 0.00 0.00 0.00 0.00 03:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:13:01 AM eth0 1.00 0.35 0.19 0.09 0.00 0.00 0.00 0.00 03:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:14:01 AM eth0 0.85 0.00 0.06 0.00 0.00 0.00 0.00 0.00 03:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:15:01 AM eth0 0.68 0.25 0.04 0.02 0.00 0.00 0.00 0.00 03:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:16:01 AM eth0 0.53 0.05 0.04 0.00 0.00 0.00 0.00 0.00 03:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:17:01 AM eth0 0.60 0.22 0.04 0.02 0.00 0.00 0.00 0.00 03:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:18:01 AM eth0 0.82 0.17 0.25 0.07 0.00 0.00 0.00 0.00 03:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:19:01 AM eth0 0.87 0.58 0.09 0.12 0.00 0.00 0.00 0.00 03:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:20:01 AM eth0 11.90 9.52 2.93 1.87 0.00 0.00 0.00 0.00 03:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:21:01 AM eth0 11.20 9.01 2.79 1.79 0.00 0.00 0.00 0.00 03:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:22:01 AM eth0 10.63 9.02 2.72 1.81 0.00 0.00 0.00 0.00 03:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:23:01 AM eth0 12.40 9.60 3.30 2.08 0.00 0.00 0.00 0.00 03:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:24:01 AM eth0 11.00 9.02 2.74 1.79 0.00 0.00 0.00 0.00 03:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:25:01 AM eth0 10.88 8.98 2.73 1.79 0.00 0.00 0.00 0.00 03:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:26:01 AM eth0 2.93 2.35 0.61 0.46 0.00 0.00 0.00 0.00 03:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:27:01 AM eth0 0.48 0.00 0.08 0.00 0.00 0.00 0.00 0.00 03:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:28:01 AM eth0 1.25 0.52 0.41 0.28 0.00 0.00 0.00 0.00 03:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:29:01 AM eth0 0.22 0.10 0.02 0.00 0.00 0.00 0.00 0.00 03:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:30:01 AM eth0 0.33 0.00 0.02 0.00 0.00 0.00 0.00 0.00 03:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:31:01 AM eth0 0.47 0.18 0.05 0.02 0.00 0.00 0.00 0.00 03:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:32:01 AM eth0 0.78 0.05 0.08 0.00 0.00 0.00 0.00 0.00 03:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:33:01 AM eth0 0.95 0.50 0.36 0.27 0.00 0.00 0.00 0.00 03:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:34:01 AM eth0 0.43 0.12 0.14 0.01 0.00 0.00 0.00 0.00 03:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:35:01 AM eth0 0.37 0.17 0.02 0.01 0.00 0.00 0.00 0.00 03:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:36:01 AM eth0 0.28 0.00 0.02 0.00 0.00 0.00 0.00 0.00 03:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:37:01 AM eth0 0.62 0.18 0.08 0.02 0.00 0.00 0.00 0.00 03:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:38:01 AM eth0 0.42 0.13 0.09 0.07 0.00 0.00 0.00 0.00 03:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:39:01 AM eth0 2.05 1.77 0.43 0.36 0.00 0.00 0.00 0.00 03:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:40:01 AM eth0 8.95 7.83 2.24 1.52 0.00 0.00 0.00 0.00 03:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:41:01 AM eth0 11.05 9.02 2.78 1.79 0.00 0.00 0.00 0.00 03:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:42:01 AM eth0 11.28 9.21 2.85 1.80 0.00 0.00 0.00 0.00 03:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:43:01 AM eth0 10.48 9.12 2.74 1.85 0.00 0.00 0.00 0.00 03:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:44:01 AM eth0 11.33 9.20 2.87 1.84 0.00 0.00 0.00 0.00 03:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:45:01 AM eth0 11.18 9.15 2.83 1.81 0.00 0.00 0.00 0.00 03:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:46:01 AM eth0 17.35 14.70 4.44 2.80 0.00 0.00 0.00 0.00 03:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:47:01 AM eth0 0.42 0.30 0.08 0.04 0.00 0.00 0.00 0.00 03:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:48:01 AM eth0 0.40 0.15 0.10 0.07 0.00 0.00 0.00 0.00 03:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:49:01 AM eth0 0.68 0.42 0.14 0.05 0.00 0.00 0.00 0.00 03:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:50:01 AM eth0 56.03 28.46 38.95 25.32 0.00 0.00 0.00 0.00 03:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:51:01 AM eth0 0.43 0.35 0.08 0.05 0.00 0.00 0.00 0.00 03:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:52:01 AM eth0 0.25 0.00 0.02 0.00 0.00 0.00 0.00 0.00 03:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:53:01 AM eth0 10.21 9.68 1.93 1.23 0.00 0.00 0.00 0.00 03:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:54:01 AM eth0 5.25 5.13 0.74 0.39 0.00 0.00 0.00 0.00 03:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:55:01 AM eth0 0.72 0.53 0.16 0.09 0.00 0.00 0.00 0.00 03:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:56:01 AM eth0 0.32 0.10 0.02 0.00 0.00 0.00 0.00 0.00 03:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:57:01 AM eth0 4.10 4.02 0.59 0.33 0.00 0.00 0.00 0.00 03:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:58:01 AM eth0 11.95 10.03 3.08 2.01 0.00 0.00 0.00 0.00 03:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 03:59:01 AM eth0 10.98 9.07 2.77 1.79 0.00 0.00 0.00 0.00 04:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:00:01 AM eth0 11.38 9.15 2.85 1.80 0.00 0.00 0.00 0.00 04:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:01:01 AM eth0 10.96 8.98 2.75 1.79 0.00 0.00 0.00 0.00 04:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:02:01 AM eth0 11.28 9.45 3.06 2.04 0.00 0.00 0.00 0.00 04:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:03:01 AM eth0 11.51 9.30 2.96 1.87 0.00 0.00 0.00 0.00 04:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:04:01 AM eth0 3.35 2.73 0.79 0.54 0.00 0.00 0.00 0.00 04:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:05:01 AM eth0 2.48 2.23 0.59 0.47 0.00 0.00 0.00 0.00 04:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:06:01 AM eth0 11.63 9.65 2.96 1.93 0.00 0.00 0.00 0.00 04:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:07:01 AM eth0 11.51 9.28 2.89 1.81 0.00 0.00 0.00 0.00 04:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:08:01 AM eth0 11.10 9.13 2.87 1.85 0.00 0.00 0.00 0.00 04:09:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:09:02 AM eth0 10.78 8.98 2.72 1.79 0.00 0.00 0.00 0.00 04:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:10:01 AM eth0 10.54 8.76 2.65 1.74 0.00 0.00 0.00 0.00 04:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:11:01 AM eth0 10.60 9.01 2.69 1.83 0.00 0.00 0.00 0.00 04:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:12:01 AM eth0 3.50 2.87 0.71 0.52 0.00 0.00 0.00 0.00 04:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:13:01 AM eth0 5.67 4.82 1.49 0.99 0.00 0.00 0.00 0.00 04:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:14:01 AM eth0 11.08 9.25 2.82 1.81 0.00 0.00 0.00 0.00 04:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:15:01 AM eth0 10.65 8.95 2.74 1.78 0.00 0.00 0.00 0.00 04:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:16:01 AM eth0 10.75 9.05 2.77 1.79 0.00 0.00 0.00 0.00 04:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:17:01 AM eth0 11.08 9.71 2.75 1.85 0.00 0.00 0.00 0.00 04:18:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:18:01 AM eth0 11.08 9.03 2.86 1.85 0.00 0.00 0.00 0.00 04:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:19:01 AM eth0 20.96 17.75 5.37 3.42 0.00 0.00 0.00 0.00 04:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:20:01 AM eth0 0.92 0.37 0.15 0.06 0.00 0.00 0.00 0.00 04:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:21:01 AM eth0 0.62 0.00 0.07 0.00 0.00 0.00 0.00 0.00 04:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:22:01 AM eth0 0.63 0.30 0.10 0.04 0.00 0.00 0.00 0.00 04:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:23:01 AM eth0 0.43 0.13 0.16 0.07 0.00 0.00 0.00 0.00 04:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:24:01 AM eth0 0.57 0.30 0.09 0.04 0.00 0.00 0.00 0.00 04:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:25:01 AM eth0 0.48 0.07 0.03 0.00 0.00 0.00 0.00 0.00 04:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:26:01 AM eth0 0.17 0.07 0.02 0.00 0.00 0.00 0.00 0.00 04:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:27:01 AM eth0 15.11 14.70 2.53 1.45 0.00 0.00 0.00 0.00 04:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:28:01 AM eth0 0.88 0.73 0.16 0.17 0.00 0.00 0.00 0.00 04:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:29:01 AM eth0 0.25 0.12 0.07 0.01 0.00 0.00 0.00 0.00 04:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:30:01 AM eth0 5.17 5.07 0.71 0.35 0.00 0.00 0.00 0.00 04:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:31:01 AM eth0 5.11 5.11 0.75 0.44 0.00 0.00 0.00 0.00 04:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:32:01 AM eth0 9.38 8.82 1.35 0.66 0.00 0.00 0.00 0.00 04:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:33:01 AM eth0 8.32 7.97 1.26 13.55 0.00 0.00 0.00 0.00 04:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:34:01 AM eth0 0.68 0.38 0.10 0.04 0.00 0.00 0.00 0.00 04:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:35:01 AM eth0 0.07 0.00 0.01 0.00 0.00 0.00 0.00 0.00 04:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:36:01 AM eth0 9.08 8.87 1.55 0.92 0.00 0.00 0.00 0.00 04:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:37:01 AM eth0 11.51 9.56 2.87 1.88 0.00 0.00 0.00 0.00 04:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:38:01 AM eth0 14.00 11.53 3.31 27.39 0.00 0.00 0.00 0.00 04:39:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:39:01 AM eth0 10.95 8.98 2.76 1.79 0.00 0.00 0.00 0.00 04:40:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:40:01 AM eth0 13.48 11.26 3.21 19.33 0.00 0.00 0.00 0.00 04:41:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:41:01 AM eth0 12.91 9.11 3.05 1.80 0.00 0.00 0.00 0.00 04:42:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:42:01 AM eth0 11.48 9.12 3.03 1.98 0.00 0.00 0.00 0.00 04:43:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:43:01 AM eth0 16.29 13.80 4.26 2.67 0.00 0.00 0.00 0.00 04:44:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:44:01 AM eth0 0.32 0.13 0.05 0.02 0.00 0.00 0.00 0.00 04:45:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:45:01 AM eth0 6.28 0.10 0.76 0.01 0.00 0.00 0.00 0.00 04:46:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:46:01 AM eth0 1.50 0.65 0.65 0.45 0.00 0.00 0.00 0.00 04:47:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:47:01 AM eth0 0.77 0.37 0.75 0.56 0.00 0.00 0.00 0.00 04:48:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:48:01 AM eth0 0.72 0.42 0.21 0.11 0.00 0.00 0.00 0.00 04:49:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:49:01 AM eth0 3.82 0.00 0.51 0.00 0.00 0.00 0.00 0.00 04:50:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:50:01 AM eth0 13.48 9.53 2.17 1.06 0.00 0.00 0.00 0.00 04:51:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:51:01 AM eth0 5.63 5.13 0.76 0.39 0.00 0.00 0.00 0.00 04:52:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:52:01 AM eth0 0.95 0.60 0.10 0.10 0.00 0.00 0.00 0.00 04:53:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:53:01 AM eth0 0.97 0.27 0.18 0.07 0.00 0.00 0.00 0.00 04:54:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:54:01 AM eth0 10.26 8.97 1.41 0.68 0.00 0.00 0.00 0.00 04:55:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:55:01 AM eth0 6.40 4.93 1.04 0.56 0.00 0.00 0.00 0.00 04:56:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:56:01 AM eth0 5.71 4.55 0.75 0.42 0.00 0.00 0.00 0.00 04:57:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:57:01 AM eth0 6.06 5.25 0.78 0.40 0.00 0.00 0.00 0.00 04:58:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:58:01 AM eth0 3.07 0.52 0.94 0.48 0.00 0.00 0.00 0.00 04:59:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 04:59:01 AM eth0 9.20 8.85 1.50 0.88 0.00 0.00 0.00 0.00 05:00:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:00:01 AM eth0 9.28 4.90 1.90 0.94 0.00 0.00 0.00 0.00 05:01:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:01:01 AM eth0 13.40 9.05 3.03 1.79 0.00 0.00 0.00 0.00 05:02:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:02:01 AM eth0 12.09 9.55 3.34 2.22 0.00 0.00 0.00 0.00 05:03:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:03:01 AM eth0 11.63 9.25 2.97 1.87 0.00 0.00 0.00 0.00 05:04:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:04:01 AM eth0 10.98 8.95 2.74 1.78 0.00 0.00 0.00 0.00 05:05:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:05:01 AM eth0 11.10 8.92 2.73 1.78 0.00 0.00 0.00 0.00 05:06:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:06:01 AM eth0 21.21 17.68 5.47 3.41 0.00 0.00 0.00 0.00 05:07:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:07:01 AM eth0 1.27 0.58 0.27 0.11 0.00 0.00 0.00 0.00 05:08:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:08:01 AM eth0 1.58 1.03 0.70 0.43 0.00 0.00 0.00 0.00 05:09:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:09:01 AM eth0 0.92 0.60 0.27 0.13 0.00 0.00 0.00 0.00 05:10:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:10:01 AM eth0 2.33 0.50 0.42 0.11 0.00 0.00 0.00 0.00 05:11:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:11:01 AM eth0 0.83 0.60 0.26 0.13 0.00 0.00 0.00 0.00 05:12:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:12:01 AM eth0 0.87 0.60 0.26 0.13 0.00 0.00 0.00 0.00 05:13:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:13:01 AM eth0 14.10 13.60 2.51 1.45 0.00 0.00 0.00 0.00 05:14:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:14:01 AM eth0 4.52 4.27 0.62 0.36 0.00 0.00 0.00 0.00 05:15:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:15:01 AM eth0 0.62 0.28 0.07 0.06 0.00 0.00 0.00 0.00 05:16:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:16:01 AM eth0 6.08 5.87 0.93 0.57 0.00 0.00 0.00 0.00 05:17:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:17:01 AM eth0 12.13 11.06 2.23 1.29 0.00 0.00 0.00 0.00 05:18:02 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:18:02 AM eth0 11.40 9.10 2.90 1.85 0.00 0.00 0.00 0.00 05:19:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:19:01 AM eth0 11.32 9.34 3.05 2.01 0.00 0.00 0.00 0.00 05:20:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:20:01 AM eth0 10.86 8.96 2.72 1.79 0.00 0.00 0.00 0.00 05:21:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:21:01 AM eth0 11.10 9.05 2.85 1.79 0.00 0.00 0.00 0.00 05:22:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:22:01 AM eth0 11.71 9.21 3.09 1.98 0.00 0.00 0.00 0.00 05:23:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:23:01 AM eth0 11.31 9.13 2.93 1.85 0.00 0.00 0.00 0.00 05:24:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:24:01 AM eth0 13.53 11.46 3.52 2.15 0.00 0.00 0.00 0.00 05:25:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:25:01 AM eth0 0.67 0.60 0.25 0.13 0.00 0.00 0.00 0.00 05:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:26:01 AM eth0 0.78 0.60 0.26 0.13 0.00 0.00 0.00 0.00 05:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:27:01 AM eth0 0.67 0.60 0.26 0.13 0.00 0.00 0.00 0.00 05:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:28:01 AM eth0 0.87 0.70 0.33 0.19 0.00 0.00 0.00 0.00 05:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:29:01 AM eth0 0.67 0.60 0.25 0.13 0.00 0.00 0.00 0.00 05:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:30:01 AM eth0 9.78 9.55 1.81 1.10 0.00 0.00 0.00 0.00 05:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:31:01 AM eth0 9.68 9.45 2.33 1.10 0.00 0.00 0.00 0.00 05:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:32:01 AM eth0 12.33 11.46 3.63 1.56 0.00 0.00 0.00 0.00 05:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:33:01 AM eth0 9.07 8.77 2.50 1.23 0.00 0.00 0.00 0.00 05:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:34:01 AM eth0 16.01 15.60 3.51 1.88 0.00 0.00 0.00 0.00 05:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:35:01 AM eth0 8.43 8.26 2.19 0.96 0.00 0.00 0.00 0.00 05:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:36:01 AM eth0 6.92 6.58 2.09 0.89 0.00 0.00 0.00 0.00 05:37:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:37:01 AM eth0 137.78 88.00 212.75 315.81 0.00 0.00 0.00 0.00 05:38:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 05:38:01 AM eth0 17.06 16.29 15.34 8.56 0.00 0.00 0.00 0.00 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: eth0 6.72 5.08 2.20 2.08 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.18.0-553.5.1.el8.x86_64 (prd-centos8-robot-2c-8g-3091.novalocal) 10/13/2025 _x86_64_ (2 CPU) 12:00:01 AM CPU %user %nice %system %iowait %steal %idle 12:01:01 AM all 4.55 0.03 0.53 0.11 0.06 94.73 12:01:01 AM 0 3.08 0.03 0.38 0.02 0.05 96.44 12:01:01 AM 1 6.02 0.02 0.67 0.20 0.07 93.03 12:02:01 AM all 5.51 0.00 0.50 0.02 0.06 93.91 12:02:01 AM 0 5.53 0.00 0.42 0.00 0.07 93.98 12:02:01 AM 1 5.50 0.00 0.58 0.03 0.05 93.84 12:03:01 AM all 3.35 0.00 0.25 0.11 0.04 96.25 12:03:01 AM 0 2.64 0.00 0.23 0.22 0.03 96.87 12:03:01 AM 1 4.06 0.00 0.27 0.00 0.05 95.62 12:04:01 AM all 0.22 0.00 0.07 0.00 0.03 99.69 12:04:01 AM 0 0.28 0.00 0.08 0.00 0.03 99.60 12:04:01 AM 1 0.15 0.00 0.05 0.00 0.02 99.78 12:05:01 AM all 0.50 0.00 0.08 0.00 0.03 99.40 12:05:01 AM 0 0.80 0.00 0.05 0.00 0.02 99.13 12:05:01 AM 1 0.20 0.00 0.10 0.00 0.03 99.67 12:06:01 AM all 0.33 0.00 0.09 0.00 0.02 99.57 12:06:01 AM 0 0.37 0.00 0.07 0.00 0.00 99.57 12:06:01 AM 1 0.28 0.00 0.12 0.00 0.03 99.57 12:07:01 AM all 0.37 0.00 0.09 0.00 0.03 99.51 12:07:01 AM 0 0.57 0.00 0.08 0.00 0.03 99.32 12:07:01 AM 1 0.17 0.00 0.10 0.00 0.03 99.70 12:08:01 AM all 0.53 0.00 0.10 0.08 0.03 99.25 12:08:01 AM 0 0.52 0.00 0.12 0.00 0.03 99.33 12:08:01 AM 1 0.55 0.00 0.08 0.17 0.03 99.17 12:09:01 AM all 0.29 0.00 0.08 0.00 0.02 99.61 12:09:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75 12:09:01 AM 1 0.45 0.00 0.08 0.00 0.00 99.47 12:10:01 AM all 5.44 0.01 2.43 0.07 0.10 91.96 12:10:01 AM 0 10.89 0.00 4.85 0.14 0.13 83.99 12:10:01 AM 1 0.40 0.02 0.18 0.00 0.07 99.33 12:11:01 AM all 6.14 0.00 2.12 0.11 0.06 91.57 12:11:01 AM 0 2.31 0.00 0.26 0.12 0.03 97.28 12:11:01 AM 1 10.21 0.00 4.12 0.09 0.09 85.49 12:11:01 AM CPU %user %nice %system %iowait %steal %idle 12:12:01 AM all 3.14 0.00 1.33 0.01 0.05 95.47 12:12:01 AM 0 4.00 0.00 2.43 0.00 0.05 93.52 12:12:01 AM 1 2.29 0.00 0.25 0.02 0.05 97.38 12:13:01 AM all 0.28 0.00 0.09 0.00 0.03 99.60 12:13:01 AM 0 0.13 0.00 0.08 0.00 0.03 99.75 12:13:01 AM 1 0.43 0.00 0.10 0.00 0.02 99.45 12:14:01 AM all 2.69 0.00 0.88 0.00 0.05 96.38 12:14:01 AM 0 5.12 0.00 1.67 0.00 0.05 93.16 12:14:01 AM 1 0.35 0.00 0.12 0.00 0.05 99.48 12:15:01 AM all 1.70 0.00 1.10 0.00 0.03 97.17 12:15:01 AM 0 3.26 0.00 2.09 0.00 0.03 94.62 12:15:01 AM 1 0.18 0.00 0.13 0.00 0.03 99.65 12:16:01 AM all 0.38 0.00 0.07 0.00 0.03 99.52 12:16:01 AM 0 0.62 0.00 0.07 0.00 0.03 99.28 12:16:01 AM 1 0.15 0.00 0.07 0.00 0.03 99.75 12:17:01 AM all 4.13 0.29 1.61 0.58 0.08 93.30 12:17:01 AM 0 5.02 0.00 1.11 0.00 0.07 93.80 12:17:01 AM 1 3.26 0.58 2.11 1.15 0.09 92.81 12:18:01 AM all 0.65 0.00 0.10 0.14 0.03 99.07 12:18:01 AM 0 0.67 0.00 0.07 0.00 0.03 99.23 12:18:01 AM 1 0.64 0.00 0.13 0.28 0.03 98.91 12:19:01 AM all 0.38 0.00 0.09 0.00 0.03 99.51 12:19:01 AM 0 0.57 0.00 0.05 0.00 0.02 99.37 12:19:01 AM 1 0.18 0.00 0.13 0.00 0.03 99.65 12:20:01 AM all 4.07 0.00 1.91 0.00 0.07 93.95 12:20:01 AM 0 0.67 0.00 0.17 0.00 0.07 99.10 12:20:01 AM 1 7.71 0.00 3.76 0.00 0.07 88.46 12:21:01 AM all 0.36 0.00 0.09 0.00 0.03 99.52 12:21:01 AM 0 0.57 0.00 0.08 0.00 0.02 99.33 12:21:01 AM 1 0.15 0.00 0.10 0.00 0.03 99.72 12:22:01 AM all 1.13 0.00 0.14 0.01 0.03 98.69 12:22:01 AM 0 0.38 0.00 0.08 0.00 0.03 99.50 12:22:01 AM 1 1.88 0.00 0.20 0.02 0.03 97.87 12:22:01 AM CPU %user %nice %system %iowait %steal %idle 12:23:01 AM all 3.45 0.00 1.48 0.00 0.05 95.02 12:23:01 AM 0 0.40 0.00 0.13 0.00 0.03 99.43 12:23:01 AM 1 6.68 0.00 2.90 0.00 0.07 90.34 12:24:01 AM all 0.39 0.00 0.07 0.00 0.03 99.51 12:24:01 AM 0 0.63 0.00 0.05 0.00 0.03 99.28 12:24:01 AM 1 0.15 0.00 0.08 0.00 0.03 99.73 12:25:01 AM all 2.62 0.00 0.61 0.00 0.05 96.72 12:25:01 AM 0 0.55 0.00 0.17 0.00 0.03 99.25 12:25:01 AM 1 4.76 0.00 1.07 0.00 0.07 94.10 12:26:01 AM all 2.00 0.00 1.41 0.00 0.04 96.54 12:26:01 AM 0 0.42 0.00 0.12 0.00 0.03 99.43 12:26:01 AM 1 3.62 0.00 2.74 0.00 0.05 93.59 12:27:01 AM all 0.33 0.00 0.10 0.00 0.06 99.52 12:27:01 AM 0 0.13 0.00 0.12 0.00 0.05 99.70 12:27:01 AM 1 0.52 0.00 0.08 0.00 0.07 99.33 12:28:01 AM all 3.93 0.00 1.39 0.00 0.04 94.64 12:28:01 AM 0 7.30 0.00 2.74 0.00 0.05 89.90 12:28:01 AM 1 0.77 0.00 0.12 0.00 0.03 99.08 12:29:01 AM all 0.88 0.00 0.13 0.00 0.03 98.96 12:29:01 AM 0 1.26 0.00 0.18 0.00 0.03 98.52 12:29:01 AM 1 0.50 0.00 0.08 0.00 0.02 99.40 12:30:01 AM all 0.43 0.00 0.13 0.00 0.03 99.42 12:30:01 AM 0 0.20 0.00 0.15 0.00 0.05 99.60 12:30:01 AM 1 0.65 0.00 0.10 0.00 0.02 99.23 12:31:01 AM all 4.29 0.00 1.90 0.00 0.07 93.74 12:31:01 AM 0 8.51 0.00 3.79 0.00 0.09 87.62 12:31:01 AM 1 0.33 0.00 0.13 0.00 0.05 99.48 12:32:01 AM all 0.39 0.00 0.08 0.00 0.03 99.50 12:32:01 AM 0 0.50 0.00 0.08 0.00 0.02 99.40 12:32:01 AM 1 0.28 0.00 0.08 0.00 0.03 99.60 12:33:01 AM all 0.34 0.00 0.09 0.00 0.03 99.54 12:33:01 AM 0 0.50 0.00 0.10 0.00 0.02 99.38 12:33:01 AM 1 0.18 0.00 0.08 0.00 0.03 99.70 12:33:01 AM CPU %user %nice %system %iowait %steal %idle 12:34:01 AM all 0.38 0.00 0.09 0.00 0.03 99.51 12:34:01 AM 0 0.62 0.00 0.08 0.00 0.03 99.26 12:34:01 AM 1 0.13 0.00 0.10 0.00 0.02 99.75 12:35:01 AM all 0.36 0.00 0.08 0.00 0.03 99.53 12:35:01 AM 0 0.54 0.00 0.07 0.00 0.03 99.36 12:35:01 AM 1 0.18 0.00 0.10 0.00 0.02 99.70 12:36:01 AM all 0.41 0.00 0.08 0.00 0.03 99.48 12:36:01 AM 0 0.63 0.00 0.05 0.00 0.03 99.28 12:36:01 AM 1 0.18 0.00 0.10 0.00 0.03 99.68 12:37:01 AM all 0.25 0.00 0.09 0.00 0.03 99.62 12:37:01 AM 0 0.35 0.00 0.10 0.00 0.03 99.51 12:37:01 AM 1 0.15 0.00 0.08 0.00 0.03 99.73 12:38:01 AM all 0.40 0.00 0.08 0.00 0.03 99.48 12:38:01 AM 0 0.65 0.00 0.08 0.00 0.03 99.23 12:38:01 AM 1 0.15 0.00 0.08 0.00 0.03 99.73 12:39:02 AM all 5.49 0.00 2.43 0.00 0.07 92.01 12:39:02 AM 0 10.10 0.00 4.81 0.00 0.09 85.00 12:39:02 AM 1 1.19 0.00 0.22 0.00 0.05 98.54 12:40:01 AM all 5.30 0.00 0.38 0.00 0.05 94.27 12:40:01 AM 0 3.90 0.00 0.29 0.00 0.05 95.75 12:40:01 AM 1 6.68 0.00 0.46 0.00 0.05 92.81 12:41:01 AM all 4.50 0.00 0.36 0.00 0.06 95.08 12:41:01 AM 0 3.13 0.00 0.33 0.00 0.05 96.48 12:41:01 AM 1 5.87 0.00 0.38 0.00 0.07 93.68 12:42:01 AM all 4.47 0.00 0.32 0.01 0.06 95.15 12:42:01 AM 0 3.85 0.00 0.27 0.02 0.07 95.80 12:42:01 AM 1 5.08 0.00 0.37 0.00 0.05 94.50 12:43:01 AM all 4.53 0.00 0.34 0.00 0.07 95.06 12:43:01 AM 0 2.54 0.00 0.23 0.00 0.08 97.14 12:43:01 AM 1 6.52 0.00 0.45 0.00 0.05 92.98 12:44:01 AM all 4.49 0.00 0.33 0.00 0.07 95.12 12:44:01 AM 0 3.41 0.00 0.23 0.00 0.07 96.29 12:44:01 AM 1 5.57 0.00 0.42 0.00 0.07 93.95 12:44:01 AM CPU %user %nice %system %iowait %steal %idle 12:45:01 AM all 4.62 0.00 0.29 0.00 0.08 95.01 12:45:01 AM 0 3.68 0.00 0.25 0.00 0.08 95.99 12:45:01 AM 1 5.57 0.00 0.33 0.00 0.07 94.03 12:46:01 AM all 5.92 0.00 0.34 0.00 0.06 93.68 12:46:01 AM 0 3.87 0.00 0.27 0.00 0.05 95.82 12:46:01 AM 1 7.98 0.00 0.42 0.00 0.07 91.54 12:47:01 AM all 0.46 0.00 0.07 0.00 0.03 99.45 12:47:01 AM 0 0.57 0.00 0.10 0.00 0.03 99.30 12:47:01 AM 1 0.35 0.00 0.03 0.00 0.02 99.60 12:48:01 AM all 0.38 0.00 0.06 0.00 0.04 99.52 12:48:01 AM 0 0.58 0.00 0.05 0.00 0.03 99.33 12:48:01 AM 1 0.18 0.00 0.07 0.00 0.05 99.70 12:49:01 AM all 0.44 0.00 0.08 0.00 0.03 99.45 12:49:01 AM 0 0.35 0.00 0.08 0.00 0.03 99.53 12:49:01 AM 1 0.53 0.00 0.07 0.00 0.03 99.37 12:50:01 AM all 0.38 0.00 0.09 0.00 0.03 99.50 12:50:01 AM 0 0.15 0.00 0.12 0.00 0.05 99.68 12:50:01 AM 1 0.60 0.00 0.07 0.00 0.02 99.32 12:51:01 AM all 0.53 0.00 0.08 0.00 0.04 99.36 12:51:01 AM 0 0.47 0.00 0.07 0.00 0.07 99.40 12:51:01 AM 1 0.58 0.00 0.08 0.00 0.02 99.32 12:52:01 AM all 0.24 0.00 0.07 0.00 0.03 99.66 12:52:01 AM 0 0.20 0.00 0.07 0.00 0.03 99.70 12:52:01 AM 1 0.28 0.00 0.07 0.00 0.03 99.62 12:53:01 AM all 2.88 0.00 0.21 0.00 0.03 96.88 12:53:01 AM 0 0.40 0.00 0.12 0.00 0.03 99.45 12:53:01 AM 1 5.43 0.00 0.31 0.00 0.03 94.23 12:54:01 AM all 5.77 0.00 3.61 0.00 0.06 90.56 12:54:01 AM 0 4.78 0.00 2.02 0.00 0.05 93.15 12:54:01 AM 1 6.77 0.00 5.23 0.00 0.07 87.93 12:55:01 AM all 1.86 0.00 0.95 0.00 0.04 97.15 12:55:01 AM 0 3.30 0.00 1.83 0.00 0.05 94.82 12:55:01 AM 1 0.45 0.00 0.08 0.00 0.03 99.43 12:55:01 AM CPU %user %nice %system %iowait %steal %idle 12:56:01 AM all 0.36 0.00 0.06 0.00 0.04 99.54 12:56:01 AM 0 0.52 0.00 0.02 0.00 0.03 99.43 12:56:01 AM 1 0.20 0.00 0.10 0.00 0.05 99.65 12:57:01 AM all 0.46 0.00 0.13 0.00 0.04 99.37 12:57:01 AM 0 0.58 0.00 0.12 0.00 0.03 99.26 12:57:01 AM 1 0.33 0.00 0.13 0.00 0.05 99.48 12:58:01 AM all 0.61 0.00 0.14 0.00 0.05 99.20 12:58:01 AM 0 0.63 0.00 0.12 0.00 0.05 99.20 12:58:01 AM 1 0.58 0.00 0.17 0.00 0.05 99.20 12:59:01 AM all 3.89 0.00 1.40 0.00 0.07 94.64 12:59:01 AM 0 0.33 0.00 0.18 0.00 0.07 99.42 12:59:01 AM 1 7.71 0.00 2.71 0.00 0.07 89.50 01:00:01 AM all 5.10 0.00 0.23 0.00 0.07 94.61 01:00:01 AM 0 5.60 0.00 0.22 0.00 0.07 94.11 01:00:01 AM 1 4.59 0.00 0.23 0.00 0.07 95.11 01:01:01 AM all 4.46 0.00 0.21 0.00 0.08 95.25 01:01:01 AM 0 5.94 0.00 0.23 0.00 0.07 93.76 01:01:01 AM 1 2.99 0.00 0.18 0.00 0.08 96.74 01:02:01 AM all 4.42 0.00 0.21 0.00 0.07 95.30 01:02:01 AM 0 4.62 0.00 0.22 0.00 0.07 95.10 01:02:01 AM 1 4.23 0.00 0.20 0.00 0.07 95.51 01:03:01 AM all 4.49 0.00 0.18 0.00 0.05 95.29 01:03:01 AM 0 4.63 0.00 0.18 0.00 0.05 95.13 01:03:01 AM 1 4.35 0.00 0.17 0.00 0.05 95.44 01:04:01 AM all 4.48 0.00 0.19 0.00 0.06 95.27 01:04:01 AM 0 5.68 0.00 0.22 0.00 0.07 94.04 01:04:01 AM 1 3.27 0.00 0.17 0.00 0.05 96.51 01:05:01 AM all 4.72 0.00 0.22 0.00 0.07 95.00 01:05:01 AM 0 4.18 0.00 0.20 0.00 0.05 95.57 01:05:01 AM 1 5.25 0.00 0.23 0.00 0.08 94.43 01:06:01 AM all 6.03 0.00 1.20 0.00 0.08 92.69 01:06:01 AM 0 2.86 0.00 0.18 0.00 0.07 96.89 01:06:01 AM 1 9.45 0.00 2.29 0.00 0.09 88.17 01:06:01 AM CPU %user %nice %system %iowait %steal %idle 01:07:01 AM all 1.50 0.00 0.41 0.00 0.05 98.05 01:07:01 AM 0 0.62 0.00 0.08 0.00 0.05 99.25 01:07:01 AM 1 2.39 0.00 0.73 0.00 0.05 96.82 01:08:01 AM all 0.51 0.00 0.12 0.00 0.06 99.32 01:08:01 AM 0 0.48 0.00 0.07 0.00 0.03 99.42 01:08:01 AM 1 0.53 0.00 0.17 0.00 0.08 99.21 01:09:01 AM all 5.12 0.00 2.39 0.00 0.04 92.46 01:09:01 AM 0 0.85 0.00 0.17 0.00 0.03 98.95 01:09:01 AM 1 9.64 0.00 4.74 0.00 0.05 85.56 01:10:01 AM all 5.38 0.00 0.66 0.00 0.07 93.89 01:10:01 AM 0 2.62 0.00 0.25 0.00 0.05 97.07 01:10:01 AM 1 8.20 0.00 1.07 0.00 0.09 90.64 01:11:01 AM all 4.24 0.00 0.33 0.08 0.06 95.28 01:11:01 AM 0 3.18 0.00 0.27 0.17 0.05 96.33 01:11:01 AM 1 5.30 0.00 0.40 0.00 0.07 94.23 01:12:01 AM all 4.38 0.00 0.32 0.00 0.07 95.23 01:12:01 AM 0 4.57 0.00 0.32 0.00 0.08 95.03 01:12:01 AM 1 4.20 0.00 0.32 0.00 0.05 95.43 01:13:01 AM all 4.42 0.00 0.33 0.00 0.06 95.19 01:13:01 AM 0 6.14 0.00 0.40 0.00 0.07 93.39 01:13:01 AM 1 2.69 0.00 0.27 0.00 0.05 96.99 01:14:01 AM all 4.48 0.00 0.33 0.00 0.06 95.13 01:14:01 AM 0 3.78 0.00 0.27 0.00 0.05 95.90 01:14:01 AM 1 5.19 0.00 0.38 0.00 0.07 94.36 01:15:01 AM all 4.48 0.00 0.33 0.00 0.05 95.15 01:15:01 AM 0 3.93 0.00 0.32 0.00 0.05 95.70 01:15:01 AM 1 5.02 0.00 0.33 0.00 0.05 94.59 01:16:01 AM all 5.86 0.00 0.33 0.00 0.07 93.75 01:16:01 AM 0 4.27 0.00 0.27 0.00 0.07 95.40 01:16:01 AM 1 7.45 0.00 0.38 0.00 0.07 92.10 01:17:01 AM all 0.36 0.00 0.08 0.01 0.05 99.50 01:17:01 AM 0 0.53 0.00 0.05 0.00 0.03 99.38 01:17:01 AM 1 0.18 0.00 0.12 0.02 0.07 99.62 01:17:01 AM CPU %user %nice %system %iowait %steal %idle 01:18:01 AM all 0.24 0.00 0.08 0.00 0.03 99.65 01:18:01 AM 0 0.40 0.00 0.08 0.00 0.03 99.48 01:18:01 AM 1 0.08 0.00 0.08 0.00 0.02 99.82 01:19:01 AM all 0.52 0.00 0.08 0.00 0.03 99.37 01:19:01 AM 0 0.65 0.00 0.08 0.00 0.03 99.23 01:19:01 AM 1 0.38 0.00 0.07 0.00 0.03 99.52 01:20:01 AM all 0.31 0.00 0.09 0.00 0.03 99.57 01:20:01 AM 0 0.53 0.00 0.10 0.00 0.03 99.33 01:20:01 AM 1 0.08 0.00 0.08 0.00 0.03 99.80 01:21:01 AM all 0.47 0.00 0.09 0.00 0.06 99.38 01:21:01 AM 0 0.70 0.00 0.05 0.00 0.05 99.20 01:21:01 AM 1 0.23 0.00 0.13 0.00 0.07 99.57 01:22:01 AM all 0.38 0.00 0.08 0.01 0.03 99.52 01:22:01 AM 0 0.25 0.00 0.10 0.00 0.03 99.62 01:22:01 AM 1 0.50 0.00 0.05 0.02 0.02 99.42 01:23:01 AM all 3.50 0.00 0.28 0.00 0.04 96.17 01:23:01 AM 0 3.05 0.00 0.32 0.00 0.05 96.58 01:23:01 AM 1 3.95 0.00 0.24 0.00 0.03 95.78 01:24:01 AM all 6.05 0.00 4.10 0.00 0.07 89.78 01:24:01 AM 0 0.27 0.00 0.18 0.00 0.05 99.50 01:24:01 AM 1 12.45 0.00 8.44 0.00 0.09 79.02 01:25:01 AM all 1.42 0.00 0.39 0.00 0.04 98.15 01:25:01 AM 0 0.20 0.00 0.13 0.00 0.05 99.62 01:25:01 AM 1 2.65 0.00 0.65 0.00 0.03 96.66 01:26:01 AM all 0.41 0.00 0.08 0.00 0.03 99.48 01:26:01 AM 0 0.18 0.00 0.08 0.00 0.05 99.68 01:26:01 AM 1 0.63 0.00 0.07 0.00 0.02 99.28 01:27:01 AM all 5.09 0.00 1.41 0.00 0.05 93.44 01:27:01 AM 0 5.24 0.00 0.43 0.00 0.05 94.28 01:27:01 AM 1 4.93 0.00 2.41 0.00 0.05 92.60 01:28:01 AM all 4.75 0.00 0.18 0.00 0.06 95.01 01:28:01 AM 0 2.93 0.00 0.20 0.00 0.05 96.82 01:28:01 AM 1 6.57 0.00 0.17 0.00 0.07 93.19 01:28:01 AM CPU %user %nice %system %iowait %steal %idle 01:29:01 AM all 4.56 0.00 0.20 0.00 0.05 95.19 01:29:01 AM 0 4.08 0.00 0.22 0.00 0.05 95.65 01:29:01 AM 1 5.03 0.00 0.18 0.00 0.05 94.73 01:30:01 AM all 4.53 0.00 0.19 0.00 0.08 95.20 01:30:01 AM 0 4.09 0.00 0.20 0.00 0.08 95.62 01:30:01 AM 1 4.96 0.00 0.18 0.00 0.07 94.79 01:31:01 AM all 4.47 0.00 0.18 0.00 0.05 95.29 01:31:01 AM 0 5.31 0.00 0.20 0.00 0.05 94.44 01:31:01 AM 1 3.64 0.00 0.17 0.00 0.05 96.14 01:32:01 AM all 4.42 0.00 0.18 0.00 0.07 95.34 01:32:01 AM 0 3.05 0.00 0.15 0.00 0.05 96.75 01:32:01 AM 1 5.78 0.00 0.20 0.00 0.08 93.93 01:33:01 AM all 4.43 0.00 0.19 0.00 0.05 95.33 01:33:01 AM 0 4.47 0.00 0.18 0.00 0.05 95.30 01:33:01 AM 1 4.38 0.00 0.20 0.00 0.05 95.36 01:34:01 AM all 5.57 0.00 1.61 0.00 0.10 92.73 01:34:01 AM 0 1.15 0.00 0.18 0.00 0.07 98.60 01:34:01 AM 1 10.42 0.00 3.17 0.00 0.13 86.27 01:35:01 AM all 6.03 0.00 1.45 0.00 0.07 92.44 01:35:01 AM 0 1.57 0.00 0.13 0.00 0.03 98.26 01:35:01 AM 1 10.94 0.00 2.90 0.00 0.11 86.05 01:36:01 AM all 4.46 0.00 0.17 0.00 0.05 95.33 01:36:01 AM 0 3.80 0.00 0.17 0.00 0.05 95.99 01:36:01 AM 1 5.12 0.00 0.17 0.00 0.05 94.67 01:37:01 AM all 4.50 0.00 0.17 0.00 0.06 95.28 01:37:01 AM 0 3.75 0.00 0.18 0.00 0.07 96.00 01:37:01 AM 1 5.25 0.00 0.15 0.00 0.05 94.55 01:38:01 AM all 4.40 0.00 0.21 0.00 0.06 95.34 01:38:01 AM 0 1.86 0.00 0.17 0.00 0.03 97.94 01:38:01 AM 1 6.94 0.00 0.25 0.00 0.08 92.73 01:39:01 AM all 4.41 0.17 0.24 0.00 0.05 95.13 01:39:01 AM 0 4.60 0.05 0.22 0.00 0.05 95.08 01:39:01 AM 1 4.21 0.28 0.27 0.00 0.05 95.19 01:39:01 AM CPU %user %nice %system %iowait %steal %idle 01:40:01 AM all 4.53 0.00 0.22 0.00 0.06 95.19 01:40:01 AM 0 5.57 0.00 0.25 0.00 0.07 94.11 01:40:01 AM 1 3.49 0.00 0.18 0.00 0.05 96.27 01:41:01 AM all 4.71 0.00 0.23 0.00 0.07 94.98 01:41:01 AM 0 3.38 0.00 0.22 0.00 0.05 96.35 01:41:01 AM 1 6.03 0.00 0.25 0.00 0.08 93.63 01:42:01 AM all 6.77 0.00 1.80 0.00 0.06 91.37 01:42:01 AM 0 10.42 0.00 3.32 0.00 0.07 86.19 01:42:01 AM 1 3.21 0.00 0.32 0.00 0.05 96.41 01:43:01 AM all 6.41 0.00 2.57 0.00 0.05 90.98 01:43:01 AM 0 12.06 0.00 5.11 0.00 0.07 82.76 01:43:01 AM 1 0.99 0.00 0.13 0.00 0.03 98.85 01:44:01 AM all 4.32 0.00 0.30 0.00 0.06 95.32 01:44:01 AM 0 6.06 0.00 0.42 0.00 0.07 93.46 01:44:01 AM 1 2.59 0.00 0.18 0.00 0.05 97.18 01:45:01 AM all 4.35 0.00 0.33 0.00 0.05 95.28 01:45:01 AM 0 4.87 0.00 0.32 0.00 0.07 94.74 01:45:01 AM 1 3.83 0.00 0.33 0.00 0.03 95.81 01:46:01 AM all 4.42 0.00 0.30 0.00 0.06 95.22 01:46:01 AM 0 4.46 0.00 0.33 0.00 0.05 95.15 01:46:01 AM 1 4.38 0.00 0.27 0.00 0.07 95.29 01:47:01 AM all 4.53 0.00 0.31 0.00 0.06 95.10 01:47:01 AM 0 2.95 0.00 0.23 0.00 0.05 96.77 01:47:01 AM 1 6.11 0.00 0.38 0.00 0.07 93.43 01:48:02 AM all 4.37 0.00 0.30 0.00 0.04 95.29 01:48:02 AM 0 4.65 0.00 0.38 0.00 0.05 94.91 01:48:02 AM 1 4.09 0.00 0.22 0.00 0.03 95.66 01:49:01 AM all 6.96 0.00 0.41 0.00 0.07 92.56 01:49:01 AM 0 3.23 0.00 0.27 0.00 0.07 96.43 01:49:01 AM 1 10.68 0.00 0.54 0.00 0.07 88.70 01:50:01 AM all 0.38 0.00 0.08 0.00 0.03 99.50 01:50:01 AM 0 0.17 0.00 0.08 0.00 0.03 99.72 01:50:01 AM 1 0.60 0.00 0.08 0.00 0.03 99.28 01:50:01 AM CPU %user %nice %system %iowait %steal %idle 01:51:01 AM all 0.35 0.00 0.07 0.01 0.03 99.55 01:51:01 AM 0 0.57 0.00 0.07 0.02 0.03 99.32 01:51:01 AM 1 0.13 0.00 0.07 0.00 0.02 99.78 01:52:01 AM all 0.49 0.00 0.08 0.00 0.03 99.39 01:52:01 AM 0 0.58 0.00 0.07 0.00 0.03 99.32 01:52:01 AM 1 0.40 0.00 0.10 0.00 0.03 99.47 01:53:01 AM all 0.33 0.00 0.08 0.00 0.02 99.58 01:53:01 AM 0 0.60 0.00 0.08 0.00 0.02 99.30 01:53:01 AM 1 0.05 0.00 0.07 0.00 0.02 99.87 01:54:01 AM all 0.40 0.00 0.07 0.00 0.03 99.50 01:54:01 AM 0 0.42 0.00 0.08 0.00 0.03 99.46 01:54:01 AM 1 0.38 0.00 0.05 0.00 0.03 99.53 01:55:01 AM all 0.33 0.00 0.07 0.00 0.03 99.57 01:55:01 AM 0 0.58 0.00 0.05 0.00 0.03 99.33 01:55:01 AM 1 0.08 0.00 0.08 0.00 0.02 99.82 01:56:01 AM all 1.43 0.00 0.09 0.00 0.03 98.46 01:56:01 AM 0 0.67 0.00 0.08 0.00 0.02 99.23 01:56:01 AM 1 2.19 0.00 0.10 0.00 0.03 97.68 01:57:01 AM all 6.06 0.00 2.40 0.00 0.06 91.48 01:57:01 AM 0 5.41 0.00 0.41 0.00 0.05 94.13 01:57:01 AM 1 6.75 0.00 4.51 0.00 0.07 88.67 01:58:01 AM all 2.96 0.00 1.84 0.00 0.05 95.15 01:58:01 AM 0 0.47 0.00 0.13 0.00 0.05 99.35 01:58:01 AM 1 5.58 0.00 3.64 0.00 0.05 90.73 01:59:01 AM all 0.34 0.00 0.06 0.00 0.03 99.57 01:59:01 AM 0 0.18 0.00 0.08 0.00 0.03 99.70 01:59:01 AM 1 0.50 0.00 0.03 0.00 0.02 99.45 02:00:01 AM all 2.40 0.00 0.49 0.00 0.04 97.07 02:00:01 AM 0 0.35 0.00 0.15 0.00 0.05 99.45 02:00:01 AM 1 4.54 0.00 0.83 0.00 0.03 94.59 02:01:01 AM all 5.80 0.00 1.29 0.00 0.05 92.86 02:01:01 AM 0 7.56 0.00 2.40 0.00 0.05 89.99 02:01:01 AM 1 4.08 0.00 0.20 0.00 0.05 95.67 02:01:01 AM CPU %user %nice %system %iowait %steal %idle 02:02:01 AM all 4.37 0.00 0.20 0.00 0.05 95.38 02:02:01 AM 0 4.60 0.00 0.22 0.00 0.05 95.13 02:02:01 AM 1 4.14 0.00 0.18 0.00 0.05 95.62 02:03:01 AM all 4.36 0.00 0.18 0.00 0.05 95.40 02:03:01 AM 0 6.36 0.00 0.20 0.00 0.07 93.37 02:03:01 AM 1 2.37 0.00 0.17 0.00 0.03 97.43 02:04:01 AM all 4.39 0.00 0.19 0.00 0.06 95.36 02:04:01 AM 0 2.98 0.00 0.17 0.00 0.05 96.81 02:04:01 AM 1 5.80 0.00 0.22 0.00 0.07 93.92 02:05:01 AM all 4.38 0.00 0.20 0.01 0.06 95.35 02:05:01 AM 0 5.50 0.00 0.20 0.00 0.07 94.23 02:05:01 AM 1 3.25 0.00 0.20 0.02 0.05 96.48 02:06:01 AM all 4.52 0.00 0.17 0.00 0.05 95.26 02:06:01 AM 0 6.24 0.00 0.18 0.00 0.05 93.53 02:06:01 AM 1 2.81 0.00 0.15 0.00 0.05 96.99 02:07:01 AM all 5.99 0.00 0.36 0.00 0.06 93.59 02:07:01 AM 0 8.06 0.00 0.54 0.00 0.07 91.34 02:07:01 AM 1 3.99 0.00 0.18 0.00 0.05 95.77 02:08:01 AM all 6.30 0.00 1.44 0.00 0.06 92.20 02:08:01 AM 0 5.31 0.00 0.39 0.00 0.05 94.24 02:08:01 AM 1 7.33 0.00 2.51 0.00 0.07 90.09 02:09:01 AM all 5.78 0.00 2.38 0.00 0.06 91.78 02:09:01 AM 0 3.56 0.00 0.35 0.00 0.05 96.04 02:09:01 AM 1 8.14 0.00 4.53 0.00 0.07 87.26 02:10:01 AM all 4.47 0.00 0.35 0.00 0.05 95.13 02:10:01 AM 0 5.84 0.00 0.45 0.00 0.05 93.66 02:10:01 AM 1 3.11 0.00 0.25 0.00 0.05 96.59 02:11:01 AM all 4.44 0.00 0.30 0.00 0.06 95.20 02:11:01 AM 0 4.21 0.00 0.27 0.00 0.05 95.47 02:11:01 AM 1 4.66 0.00 0.33 0.00 0.07 94.94 02:12:01 AM all 4.46 0.00 0.31 0.03 0.08 95.13 02:12:01 AM 0 3.60 0.00 0.25 0.05 0.05 96.05 02:12:01 AM 1 5.33 0.00 0.37 0.00 0.10 94.20 02:12:01 AM CPU %user %nice %system %iowait %steal %idle 02:13:01 AM all 4.51 0.00 0.28 0.00 0.07 95.13 02:13:01 AM 0 7.60 0.00 0.44 0.00 0.07 91.90 02:13:01 AM 1 1.44 0.00 0.13 0.00 0.07 98.36 02:14:01 AM all 4.35 0.00 0.32 0.00 0.04 95.29 02:14:01 AM 0 4.24 0.00 0.28 0.00 0.03 95.45 02:14:01 AM 1 4.46 0.00 0.35 0.00 0.05 95.13 02:15:01 AM all 6.69 0.00 0.38 0.00 0.05 92.89 02:15:01 AM 0 8.47 0.00 0.47 0.00 0.05 91.01 02:15:01 AM 1 4.90 0.00 0.28 0.00 0.05 94.77 02:16:01 AM all 0.55 0.00 0.08 0.00 0.03 99.34 02:16:01 AM 0 0.28 0.00 0.10 0.00 0.03 99.58 02:16:01 AM 1 0.82 0.00 0.05 0.00 0.03 99.10 02:17:01 AM all 0.35 0.00 0.08 0.00 0.02 99.56 02:17:01 AM 0 0.12 0.00 0.08 0.00 0.02 99.78 02:17:01 AM 1 0.58 0.00 0.07 0.00 0.02 99.33 02:18:01 AM all 0.43 0.00 0.08 0.00 0.02 99.47 02:18:01 AM 0 0.13 0.00 0.10 0.00 0.03 99.73 02:18:01 AM 1 0.74 0.00 0.05 0.00 0.00 99.21 02:19:01 AM all 0.33 0.00 0.07 0.00 0.01 99.60 02:19:01 AM 0 0.07 0.00 0.07 0.00 0.00 99.87 02:19:01 AM 1 0.58 0.00 0.07 0.00 0.02 99.33 02:20:01 AM all 0.53 0.00 0.09 0.00 0.03 99.35 02:20:01 AM 0 0.40 0.00 0.12 0.00 0.02 99.47 02:20:01 AM 1 0.67 0.00 0.07 0.00 0.03 99.23 02:21:01 AM all 0.24 0.00 0.08 0.00 0.02 99.66 02:21:01 AM 0 0.07 0.00 0.07 0.00 0.02 99.85 02:21:01 AM 1 0.42 0.00 0.10 0.00 0.02 99.47 02:22:01 AM all 1.78 0.00 0.13 0.00 0.03 98.05 02:22:01 AM 0 1.69 0.00 0.13 0.00 0.05 98.13 02:22:01 AM 1 1.88 0.00 0.13 0.00 0.02 97.97 02:23:01 AM all 6.33 0.00 2.54 0.00 0.07 91.06 02:23:01 AM 0 3.00 0.00 0.34 0.00 0.07 96.59 02:23:01 AM 1 9.93 0.00 4.92 0.00 0.07 85.08 02:23:01 AM CPU %user %nice %system %iowait %steal %idle 02:24:01 AM all 3.56 0.00 1.81 0.00 0.06 94.57 02:24:01 AM 0 6.62 0.00 3.56 0.00 0.07 89.75 02:24:01 AM 1 0.60 0.00 0.12 0.00 0.05 99.23 02:25:01 AM all 0.39 0.00 0.06 0.00 0.03 99.52 02:25:01 AM 0 0.17 0.00 0.08 0.00 0.03 99.72 02:25:01 AM 1 0.62 0.00 0.03 0.00 0.02 99.33 02:26:01 AM all 0.53 0.00 0.08 0.00 0.03 99.36 02:26:01 AM 0 0.87 0.00 0.08 0.00 0.02 99.03 02:26:01 AM 1 0.20 0.00 0.08 0.00 0.03 99.68 02:27:01 AM all 0.37 0.00 0.07 0.01 0.03 99.53 02:27:01 AM 0 0.55 0.00 0.03 0.02 0.02 99.38 02:27:01 AM 1 0.18 0.00 0.10 0.00 0.03 99.68 02:28:01 AM all 0.58 0.00 0.09 0.00 0.03 99.31 02:28:01 AM 0 0.73 0.00 0.10 0.00 0.03 99.13 02:28:01 AM 1 0.42 0.00 0.08 0.00 0.02 99.48 02:29:01 AM all 0.38 0.00 0.08 0.00 0.03 99.52 02:29:01 AM 0 0.65 0.00 0.10 0.00 0.02 99.23 02:29:01 AM 1 0.10 0.00 0.07 0.00 0.03 99.80 02:30:01 AM all 0.51 0.00 0.08 0.00 0.03 99.38 02:30:01 AM 0 0.63 0.00 0.08 0.00 0.03 99.25 02:30:01 AM 1 0.38 0.00 0.08 0.00 0.02 99.52 02:31:01 AM all 0.36 0.00 0.08 0.00 0.03 99.53 02:31:01 AM 0 0.58 0.00 0.08 0.00 0.03 99.30 02:31:01 AM 1 0.13 0.00 0.08 0.00 0.02 99.77 02:32:01 AM all 0.52 0.00 0.11 0.00 0.03 99.35 02:32:01 AM 0 0.17 0.00 0.12 0.00 0.02 99.70 02:32:01 AM 1 0.87 0.00 0.10 0.00 0.03 99.00 02:33:01 AM all 0.29 0.00 0.08 0.00 0.03 99.60 02:33:01 AM 0 0.20 0.00 0.08 0.00 0.03 99.68 02:33:01 AM 1 0.38 0.00 0.08 0.00 0.02 99.52 02:34:01 AM all 0.48 0.00 0.08 0.00 0.03 99.42 02:34:01 AM 0 0.20 0.00 0.12 0.00 0.03 99.65 02:34:01 AM 1 0.75 0.00 0.05 0.00 0.02 99.18 02:34:01 AM CPU %user %nice %system %iowait %steal %idle 02:35:01 AM all 0.35 0.00 0.08 0.00 0.02 99.56 02:35:01 AM 0 0.18 0.00 0.12 0.00 0.03 99.67 02:35:01 AM 1 0.52 0.00 0.03 0.00 0.00 99.45 02:36:01 AM all 0.53 0.00 0.09 0.00 0.04 99.34 02:36:01 AM 0 0.18 0.00 0.12 0.00 0.05 99.65 02:36:01 AM 1 0.87 0.00 0.07 0.00 0.03 99.03 02:37:01 AM all 0.23 0.00 0.08 0.00 0.02 99.67 02:37:01 AM 0 0.42 0.00 0.13 0.00 0.03 99.41 02:37:01 AM 1 0.05 0.00 0.02 0.00 0.00 99.93 02:38:01 AM all 0.37 0.00 0.06 0.00 0.03 99.55 02:38:01 AM 0 0.57 0.00 0.03 0.00 0.02 99.38 02:38:01 AM 1 0.17 0.00 0.08 0.00 0.03 99.72 02:39:01 AM all 5.51 0.00 1.42 0.00 0.07 93.00 02:39:01 AM 0 1.87 0.00 0.20 0.00 0.05 97.88 02:39:01 AM 1 9.45 0.00 2.73 0.00 0.09 87.73 02:40:01 AM all 4.45 0.00 0.20 0.00 0.04 95.31 02:40:01 AM 0 2.06 0.00 0.20 0.00 0.03 97.71 02:40:01 AM 1 6.84 0.00 0.20 0.00 0.05 92.90 02:41:01 AM all 4.54 0.00 0.19 0.00 0.06 95.21 02:41:01 AM 0 2.59 0.00 0.18 0.00 0.07 97.16 02:41:01 AM 1 6.49 0.00 0.20 0.00 0.05 93.26 02:42:01 AM all 4.51 0.00 0.20 0.00 0.06 95.23 02:42:01 AM 0 2.91 0.00 0.17 0.00 0.05 96.87 02:42:01 AM 1 6.12 0.00 0.23 0.00 0.07 93.58 02:43:01 AM all 4.48 0.00 0.22 0.00 0.04 95.26 02:43:01 AM 0 3.18 0.00 0.20 0.00 0.03 96.59 02:43:01 AM 1 5.78 0.00 0.23 0.00 0.05 93.93 02:44:01 AM all 4.77 0.00 0.18 0.00 0.06 95.00 02:44:01 AM 0 3.58 0.00 0.18 0.00 0.07 96.17 02:44:01 AM 1 5.95 0.00 0.17 0.00 0.05 93.83 02:45:01 AM all 4.65 0.00 0.20 0.00 0.05 95.10 02:45:01 AM 0 2.54 0.00 0.20 0.00 0.03 97.23 02:45:01 AM 1 6.75 0.00 0.20 0.00 0.07 92.98