06:28:55 Started by timer 06:28:55 Running as SYSTEM 06:28:55 [EnvInject] - Loading node environment variables. 06:28:55 Building remotely on prd-ubuntu2204-docker-4c-4g-2223 (ubuntu2204-docker-4c-4g) in workspace /w/workspace/openflowplugin-maven-merge-titanium 06:28:55 [ssh-agent] Looking for ssh-agent implementation... 06:28:55 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 06:28:55 $ ssh-agent 06:28:55 SSH_AUTH_SOCK=/tmp/ssh-XXXXXXi0J9yJ/agent.1565 06:28:55 SSH_AGENT_PID=1567 06:28:55 [ssh-agent] Started. 06:28:55 Running ssh-add (command line suppressed) 06:28:56 Identity added: /w/workspace/openflowplugin-maven-merge-titanium@tmp/private_key_10771914955316593297.key (/w/workspace/openflowplugin-maven-merge-titanium@tmp/private_key_10771914955316593297.key) 06:28:56 [ssh-agent] Using credentials jenkins (jenkins-ssh) 06:28:56 The recommended git tool is: NONE 06:28:57 using credential jenkins-ssh 06:28:57 Wiping out workspace first. 06:28:57 Cloning the remote Git repository 06:28:57 Cloning repository git://devvexx.opendaylight.org/mirror/openflowplugin 06:28:57 > git init /w/workspace/openflowplugin-maven-merge-titanium # timeout=10 06:28:58 Fetching upstream changes from git://devvexx.opendaylight.org/mirror/openflowplugin 06:28:58 > git --version # timeout=10 06:28:58 > git --version # 'git version 2.34.1' 06:28:58 using GIT_SSH to set credentials jenkins-ssh 06:28:58 Verifying host key using known hosts file 06:28:58 You're using 'Known hosts file' strategy to verify ssh host keys, but your known_hosts file does not exist, please go to 'Manage Jenkins' -> 'Security' -> 'Git Host Key Verification Configuration' and configure host key verification. 06:28:58 > git fetch --tags --force --progress -- git://devvexx.opendaylight.org/mirror/openflowplugin +refs/heads/*:refs/remotes/origin/* # timeout=10 06:29:01 > git config remote.origin.url git://devvexx.opendaylight.org/mirror/openflowplugin # timeout=10 06:29:01 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 06:29:01 Avoid second fetch 06:29:01 > git rev-parse refs/remotes/origin/stable/titanium^{commit} # timeout=10 06:29:01 Checking out Revision b0547c0c70bb047f184395d515a543505429484e (refs/remotes/origin/stable/titanium) 06:29:01 > git config core.sparsecheckout # timeout=10 06:29:01 > git checkout -f b0547c0c70bb047f184395d515a543505429484e # timeout=10 06:29:02 Commit message: "Fixup checkstyle" 06:29:02 > git rev-list --no-walk b0547c0c70bb047f184395d515a543505429484e # timeout=10 06:29:05 provisioning config files... 06:29:05 copy managed file [npmrc] to file:/home/jenkins/.npmrc 06:29:05 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 06:29:05 [openflowplugin-maven-merge-titanium] $ /bin/bash /tmp/jenkins10153871309852833568.sh 06:29:05 ---> python-tools-install.sh 06:29:05 Setup pyenv: 06:29:05 * system (set by /opt/pyenv/version) 06:29:05 * 3.8.20 (set by /opt/pyenv/version) 06:29:05 * 3.9.20 (set by /opt/pyenv/version) 06:29:05 3.10.15 06:29:05 3.11.10 06:29:10 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-MOLO 06:29:10 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 06:29:10 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 06:29:10 lf-activate-venv(): INFO: Attempting to install with network-safe options... 06:29:14 lf-activate-venv(): INFO: Base packages installed successfully 06:29:14 lf-activate-venv(): INFO: Installing additional packages: lftools 06:29:43 lf-activate-venv(): INFO: Adding /tmp/venv-MOLO/bin to PATH 06:29:43 Generating Requirements File 06:30:04 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 06:30:04 httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 06:30:04 deprecated 1.2.18 requires wrapt<2,>=1.10, but you have wrapt 2.0.0 which is incompatible. 06:30:04 Python 3.11.10 06:30:04 pip 25.3 from /tmp/venv-MOLO/lib/python3.11/site-packages/pip (python 3.11) 06:30:05 appdirs==1.4.4 06:30:05 argcomplete==3.6.3 06:30:05 aspy.yaml==1.3.0 06:30:05 attrs==25.4.0 06:30:05 autopage==0.5.2 06:30:05 beautifulsoup4==4.14.2 06:30:05 boto3==1.40.59 06:30:05 botocore==1.40.59 06:30:05 bs4==0.0.2 06:30:05 cachetools==6.2.1 06:30:05 certifi==2025.10.5 06:30:05 cffi==2.0.0 06:30:05 cfgv==3.4.0 06:30:05 chardet==5.2.0 06:30:05 charset-normalizer==3.4.4 06:30:05 click==8.3.0 06:30:05 cliff==4.11.0 06:30:05 cmd2==2.7.0 06:30:05 cryptography==3.3.2 06:30:05 debtcollector==3.0.0 06:30:05 decorator==5.2.1 06:30:05 defusedxml==0.7.1 06:30:05 Deprecated==1.2.18 06:30:05 distlib==0.4.0 06:30:05 dnspython==2.8.0 06:30:05 docker==7.1.0 06:30:05 dogpile.cache==1.5.0 06:30:05 durationpy==0.10 06:30:05 email-validator==2.3.0 06:30:05 filelock==3.20.0 06:30:05 future==1.0.0 06:30:05 gitdb==4.0.12 06:30:05 GitPython==3.1.45 06:30:05 google-auth==2.41.1 06:30:05 httplib2==0.31.0 06:30:05 identify==2.6.15 06:30:05 idna==3.11 06:30:05 importlib-resources==1.5.0 06:30:05 iso8601==2.1.0 06:30:05 Jinja2==3.1.6 06:30:05 jmespath==1.0.1 06:30:05 jsonpatch==1.33 06:30:05 jsonpointer==3.0.0 06:30:05 jsonschema==4.25.1 06:30:05 jsonschema-specifications==2025.9.1 06:30:05 keystoneauth1==5.12.0 06:30:05 kubernetes==34.1.0 06:30:05 lftools==0.37.15 06:30:05 lxml==6.0.2 06:30:05 markdown-it-py==4.0.0 06:30:05 MarkupSafe==3.0.3 06:30:05 mdurl==0.1.2 06:30:05 msgpack==1.1.2 06:30:05 multi_key_dict==2.0.3 06:30:05 munch==4.0.0 06:30:05 netaddr==1.3.0 06:30:05 niet==1.4.2 06:30:05 nodeenv==1.9.1 06:30:05 oauth2client==4.1.3 06:30:05 oauthlib==3.3.1 06:30:05 openstacksdk==4.7.1 06:30:05 os-service-types==1.8.0 06:30:05 osc-lib==4.2.0 06:30:05 oslo.config==10.0.0 06:30:05 oslo.context==6.1.0 06:30:05 oslo.i18n==6.6.0 06:30:05 oslo.log==7.2.1 06:30:05 oslo.serialization==5.8.0 06:30:05 oslo.utils==9.1.0 06:30:05 packaging==25.0 06:30:05 pbr==7.0.1 06:30:05 platformdirs==4.5.0 06:30:05 prettytable==3.16.0 06:30:05 psutil==7.1.2 06:30:05 pyasn1==0.6.1 06:30:05 pyasn1_modules==0.4.2 06:30:05 pycparser==2.23 06:30:05 pygerrit2==2.0.15 06:30:05 PyGithub==2.8.1 06:30:05 Pygments==2.19.2 06:30:05 PyJWT==2.10.1 06:30:05 PyNaCl==1.6.0 06:30:05 pyparsing==2.4.7 06:30:05 pyperclip==1.11.0 06:30:05 pyrsistent==0.20.0 06:30:05 python-cinderclient==9.8.0 06:30:05 python-dateutil==2.9.0.post0 06:30:05 python-heatclient==4.3.0 06:30:05 python-jenkins==1.8.3 06:30:05 python-keystoneclient==5.7.0 06:30:05 python-magnumclient==4.9.0 06:30:05 python-openstackclient==8.2.0 06:30:05 python-swiftclient==4.8.0 06:30:05 PyYAML==6.0.3 06:30:05 referencing==0.37.0 06:30:05 requests==2.32.5 06:30:05 requests-oauthlib==2.0.0 06:30:05 requestsexceptions==1.4.0 06:30:05 rfc3986==2.0.0 06:30:05 rich==14.2.0 06:30:05 rich-argparse==1.7.1 06:30:05 rpds-py==0.28.0 06:30:05 rsa==4.9.1 06:30:05 ruamel.yaml==0.18.16 06:30:05 ruamel.yaml.clib==0.2.14 06:30:05 s3transfer==0.14.0 06:30:05 simplejson==3.20.2 06:30:05 six==1.17.0 06:30:05 smmap==5.0.2 06:30:05 soupsieve==2.8 06:30:05 stevedore==5.5.0 06:30:05 tabulate==0.9.0 06:30:05 toml==0.10.2 06:30:05 tomlkit==0.13.3 06:30:05 tqdm==4.67.1 06:30:05 typing_extensions==4.15.0 06:30:05 tzdata==2025.2 06:30:05 urllib3==1.26.20 06:30:05 virtualenv==20.35.3 06:30:05 wcwidth==0.2.14 06:30:05 websocket-client==1.9.0 06:30:05 wrapt==2.0.0 06:30:05 xdg==6.0.0 06:30:05 xmltodict==1.0.2 06:30:05 yq==3.4.3 06:30:05 [openflowplugin-maven-merge-titanium] $ /bin/sh -xe /tmp/jenkins13568959692973529223.sh 06:30:05 + mkdir -p /w/workspace/openflowplugin-maven-merge-titanium/target/classes /w/workspace/openflowplugin-maven-merge-titanium/jacoco/classes 06:30:05 [openflowplugin-maven-merge-titanium] $ /bin/sh -xe /tmp/jenkins291221853997360383.sh 06:30:05 + echo quiet=on 06:30:05 Unpacking https://repo.maven.apache.org/maven2/org/apache/maven/apache-maven/3.9.6/apache-maven-3.9.6-bin.zip to /w/tools/hudson.tasks.Maven_MavenInstallation/mvn39 on prd-ubuntu2204-docker-4c-4g-2223 08:10:15 ERROR: Failed to download https://repo.maven.apache.org/maven2/org/apache/maven/apache-maven/3.9.6/apache-maven-3.9.6-bin.zip from agent; will retry from controller 08:10:15 java.util.zip.ZipException: archive is not a ZIP archive 08:10:15 at org.apache.tools.zip.ZipFile.positionAtEndOfCentralDirectoryRecord(ZipFile.java:789) 08:10:15 at org.apache.tools.zip.ZipFile.positionAtCentralDirectory(ZipFile.java:725) 08:10:15 at org.apache.tools.zip.ZipFile.populateFromCentralDirectory(ZipFile.java:461) 08:10:15 at org.apache.tools.zip.ZipFile.(ZipFile.java:217) 08:10:15 at org.apache.tools.zip.ZipFile.(ZipFile.java:192) 08:10:15 at org.apache.tools.zip.ZipFile.(ZipFile.java:152) 08:10:15 at hudson.FilePath.unzip(FilePath.java:716) 08:10:15 at hudson.FilePath.unzip(FilePath.java:706) 08:10:15 at hudson.FilePath$Unpack.invoke(FilePath.java:1122) 08:10:15 Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to prd-ubuntu2204-docker-4c-4g-2223 08:10:15 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1787) 08:10:15 at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) 08:10:15 at hudson.remoting.Channel.call(Channel.java:1003) 08:10:15 at hudson.FilePath.act(FilePath.java:1230) 08:10:15 at hudson.FilePath.act(FilePath.java:1219) 08:10:15 at hudson.FilePath.installIfNecessaryFrom(FilePath.java:1055) 08:10:15 at hudson.FilePath.installIfNecessaryFrom(FilePath.java:981) 08:10:15 at hudson.tools.DownloadFromUrlInstaller.performInstallation(DownloadFromUrlInstaller.java:77) 08:10:15 at hudson.tools.InstallerTranslator.getToolHome(InstallerTranslator.java:70) 08:10:15 at hudson.tools.ToolLocationNodeProperty.getToolHome(ToolLocationNodeProperty.java:109) 08:10:15 at hudson.tools.ToolInstallation.translateFor(ToolInstallation.java:221) 08:10:15 at hudson.tasks.Maven$MavenInstallation.forNode(Maven.java:683) 08:10:15 at hudson.tasks.Maven.perform(Maven.java:319) 08:10:15 at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) 08:10:15 at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) 08:10:15 at hudson.model.Build$BuildExecution.build(Build.java:199) 08:10:15 at hudson.model.Build$BuildExecution.doRun(Build.java:164) 08:10:15 at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:526) 08:10:15 at hudson.model.Run.execute(Run.java:1895) 08:10:15 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) 08:10:15 at hudson.model.ResourceController.execute(ResourceController.java:101) 08:10:15 at hudson.model.Executor.run(Executor.java:442) 08:10:15 Caused: java.io.IOException: Failed to unpack https://repo.maven.apache.org/maven2/org/apache/maven/apache-maven/3.9.6/apache-maven-3.9.6-bin.zip (5636096 bytes read) 08:10:15 at hudson.FilePath$Unpack.invoke(FilePath.java:1127) 08:10:15 at hudson.FilePath$Unpack.invoke(FilePath.java:1110) 08:10:15 at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3616) 08:10:15 at hudson.remoting.UserRequest.perform(UserRequest.java:211) 08:10:15 at hudson.remoting.UserRequest.perform(UserRequest.java:54) 08:10:15 at hudson.remoting.Request$2.run(Request.java:377) 08:10:15 at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78) 08:10:15 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) 08:10:15 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) 08:10:15 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) 08:10:15 at java.base/java.lang.Thread.run(Thread.java:1583) 09:29:05 Build timed out (after 180 minutes). Marking the build as failed. 09:29:05 $ ssh-agent -k 09:29:05 unset SSH_AUTH_SOCK; 09:29:05 unset SSH_AGENT_PID; 09:29:05 echo Agent pid 1567 killed; 09:29:05 [ssh-agent] Stopped. 09:29:05 Build was aborted 09:29:05 [PostBuildScript] - [INFO] Executing post build scripts. 09:29:05 [openflowplugin-maven-merge-titanium] $ /bin/bash /tmp/jenkins9896657070776816235.sh 09:29:05 ---> sysstat.sh 09:29:06 [openflowplugin-maven-merge-titanium] $ /bin/bash /tmp/jenkins13630864293813120282.sh 09:29:06 ---> package-listing.sh 09:29:06 ++ facter osfamily 09:29:06 ++ tr '[:upper:]' '[:lower:]' 09:29:06 + OS_FAMILY=debian 09:29:06 + workspace=/w/workspace/openflowplugin-maven-merge-titanium 09:29:06 + START_PACKAGES=/tmp/packages_start.txt 09:29:06 + END_PACKAGES=/tmp/packages_end.txt 09:29:06 + DIFF_PACKAGES=/tmp/packages_diff.txt 09:29:06 + PACKAGES=/tmp/packages_start.txt 09:29:06 + '[' /w/workspace/openflowplugin-maven-merge-titanium ']' 09:29:06 + PACKAGES=/tmp/packages_end.txt 09:29:06 + case "${OS_FAMILY}" in 09:29:06 + dpkg -l 09:29:06 + grep '^ii' 09:29:06 + '[' -f /tmp/packages_start.txt ']' 09:29:06 + '[' -f /tmp/packages_end.txt ']' 09:29:06 + diff /tmp/packages_start.txt /tmp/packages_end.txt 09:29:06 + '[' /w/workspace/openflowplugin-maven-merge-titanium ']' 09:29:06 + mkdir -p /w/workspace/openflowplugin-maven-merge-titanium/archives/ 09:29:06 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/openflowplugin-maven-merge-titanium/archives/ 09:29:06 [openflowplugin-maven-merge-titanium] $ /bin/bash /tmp/jenkins14099296955893221071.sh 09:29:06 ---> capture-instance-metadata.sh 09:29:06 Setup pyenv: 09:29:06 system 09:29:06 3.8.20 09:29:06 3.9.20 09:29:06 3.10.15 09:29:06 * 3.11.10 (set by /w/workspace/openflowplugin-maven-merge-titanium/.python-version) 09:29:06 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MOLO from file:/tmp/.os_lf_venv 09:29:06 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:29:06 lf-activate-venv(): INFO: Attempting to install with network-safe options... 09:29:09 lf-activate-venv(): INFO: Base packages installed successfully 09:29:09 lf-activate-venv(): INFO: Installing additional packages: lftools 09:29:23 lf-activate-venv(): INFO: Adding /tmp/venv-MOLO/bin to PATH 09:29:23 INFO: Running in OpenStack, capturing instance metadata 09:29:23 [openflowplugin-maven-merge-titanium] $ /bin/bash /tmp/jenkins8149416145054246144.sh 09:29:23 provisioning config files... 09:29:24 Could not find credentials [logs] for openflowplugin-maven-merge-titanium #459 09:29:24 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/openflowplugin-maven-merge-titanium@tmp/config3739567557201303837tmp 09:29:24 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[odl-logs-s3-cloudfront-index] 09:29:24 Run condition [Regular expression match] enabling perform for step [Provide Configuration files] 09:29:24 provisioning config files... 09:29:24 copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials 09:29:24 [EnvInject] - Injecting environment variables from a build step. 09:29:24 [EnvInject] - Injecting as environment variables the properties content 09:29:24 SERVER_ID=logs 09:29:24 09:29:24 [EnvInject] - Variables injected successfully. 09:29:24 [openflowplugin-maven-merge-titanium] $ /bin/bash /tmp/jenkins12466752411890334584.sh 09:29:24 ---> create-netrc.sh 09:29:24 WARN: Log server credential not found. 09:29:24 [openflowplugin-maven-merge-titanium] $ /bin/bash /tmp/jenkins7132166915952781105.sh 09:29:24 ---> python-tools-install.sh 09:29:24 Setup pyenv: 09:29:24 system 09:29:24 3.8.20 09:29:24 3.9.20 09:29:24 3.10.15 09:29:24 * 3.11.10 (set by /w/workspace/openflowplugin-maven-merge-titanium/.python-version) 09:29:24 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MOLO from file:/tmp/.os_lf_venv 09:29:24 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:29:24 lf-activate-venv(): INFO: Attempting to install with network-safe options... 09:29:26 lf-activate-venv(): INFO: Base packages installed successfully 09:29:26 lf-activate-venv(): INFO: Installing additional packages: lftools 09:29:36 lf-activate-venv(): INFO: Adding /tmp/venv-MOLO/bin to PATH 09:29:36 [openflowplugin-maven-merge-titanium] $ /bin/bash /tmp/jenkins2186947225437491372.sh 09:29:36 ---> sudo-logs.sh 09:29:36 Archiving 'sudo' log.. 09:29:36 [openflowplugin-maven-merge-titanium] $ /bin/bash /tmp/jenkins3360936691421020370.sh 09:29:36 ---> job-cost.sh 09:29:36 Setup pyenv: 09:29:36 system 09:29:36 3.8.20 09:29:36 3.9.20 09:29:36 3.10.15 09:29:36 * 3.11.10 (set by /w/workspace/openflowplugin-maven-merge-titanium/.python-version) 09:29:36 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MOLO from file:/tmp/.os_lf_venv 09:29:36 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:29:36 lf-activate-venv(): INFO: Attempting to install with network-safe options... 09:29:38 lf-activate-venv(): INFO: Base packages installed successfully 09:29:38 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 09:29:45 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 09:29:45 deprecated 1.2.18 requires wrapt<2,>=1.10, but you have wrapt 2.0.0 which is incompatible. 09:29:45 lf-activate-venv(): INFO: Adding /tmp/venv-MOLO/bin to PATH 09:29:45 INFO: No Stack... 09:29:46 INFO: Retrieving Pricing Info for: v3-standard-4 09:29:46 INFO: Archiving Costs 09:29:46 [openflowplugin-maven-merge-titanium] $ /bin/bash -l /tmp/jenkins13094952554990676317.sh 09:29:46 ---> logs-deploy.sh 09:29:46 Setup pyenv: 09:29:46 system 09:29:46 3.8.20 09:29:46 3.9.20 09:29:46 3.10.15 09:29:46 * 3.11.10 (set by /w/workspace/openflowplugin-maven-merge-titanium/.python-version) 09:29:46 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-MOLO from file:/tmp/.os_lf_venv 09:29:46 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:29:46 lf-activate-venv(): INFO: Attempting to install with network-safe options... 09:29:48 lf-activate-venv(): INFO: Base packages installed successfully 09:29:48 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 09:29:58 lf-activate-venv(): INFO: Adding /tmp/venv-MOLO/bin to PATH 09:29:58 WARNING: Nexus logging server not set 09:29:58 INFO: S3 path logs/releng/vex-yul-odl-jenkins-1/openflowplugin-maven-merge-titanium/459/ 09:29:58 INFO: archiving logs to S3 09:30:00 ---> uname -a: 09:30:00 Linux prd-ubuntu2204-docker-4c-4g-2223 5.15.0-153-generic #163-Ubuntu SMP Thu Aug 7 16:37:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 09:30:00 09:30:00 09:30:00 ---> lscpu: 09:30:00 Architecture: x86_64 09:30:00 CPU op-mode(s): 32-bit, 64-bit 09:30:00 Address sizes: 40 bits physical, 48 bits virtual 09:30:00 Byte Order: Little Endian 09:30:00 CPU(s): 4 09:30:00 On-line CPU(s) list: 0-3 09:30:00 Vendor ID: AuthenticAMD 09:30:00 Model name: AMD EPYC-Rome Processor 09:30:00 CPU family: 23 09:30:00 Model: 49 09:30:00 Thread(s) per core: 1 09:30:00 Core(s) per socket: 1 09:30:00 Socket(s): 4 09:30:00 Stepping: 0 09:30:00 BogoMIPS: 5599.99 09:30:00 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 09:30:00 Virtualization: AMD-V 09:30:00 Hypervisor vendor: KVM 09:30:00 Virtualization type: full 09:30:00 L1d cache: 128 KiB (4 instances) 09:30:00 L1i cache: 128 KiB (4 instances) 09:30:00 L2 cache: 2 MiB (4 instances) 09:30:00 L3 cache: 64 MiB (4 instances) 09:30:00 NUMA node(s): 1 09:30:00 NUMA node0 CPU(s): 0-3 09:30:00 Vulnerability Gather data sampling: Not affected 09:30:00 Vulnerability Indirect target selection: Not affected 09:30:00 Vulnerability Itlb multihit: Not affected 09:30:00 Vulnerability L1tf: Not affected 09:30:00 Vulnerability Mds: Not affected 09:30:00 Vulnerability Meltdown: Not affected 09:30:00 Vulnerability Mmio stale data: Not affected 09:30:00 Vulnerability Reg file data sampling: Not affected 09:30:00 Vulnerability Retbleed: Mitigation; untrained return thunk; SMT disabled 09:30:00 Vulnerability Spec rstack overflow: Mitigation; SMT disabled 09:30:00 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp 09:30:00 Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 09:30:00 Vulnerability Spectre v2: Mitigation; Retpolines; IBPB disabled; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected 09:30:00 Vulnerability Srbds: Not affected 09:30:00 Vulnerability Tsx async abort: Not affected 09:30:00 09:30:00 09:30:00 ---> nproc: 09:30:00 4 09:30:00 09:30:00 09:30:00 ---> df -h: 09:30:00 Filesystem Size Used Avail Use% Mounted on 09:30:00 tmpfs 1.6G 1.1M 1.6G 1% /run 09:30:00 /dev/vda1 78G 8.5G 69G 11% / 09:30:00 tmpfs 7.9G 0 7.9G 0% /dev/shm 09:30:00 tmpfs 5.0M 0 5.0M 0% /run/lock 09:30:00 /dev/vda15 105M 6.1M 99M 6% /boot/efi 09:30:00 tmpfs 1.6G 4.0K 1.6G 1% /run/user/1001 09:30:00 09:30:00 09:30:00 ---> free -m: 09:30:00 total used free shared buff/cache available 09:30:00 Mem: 15989 577 12577 4 2834 15081 09:30:00 Swap: 1023 0 1023 09:30:00 09:30:00 09:30:00 ---> ip addr: 09:30:00 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 09:30:00 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 09:30:00 inet 127.0.0.1/8 scope host lo 09:30:00 valid_lft forever preferred_lft forever 09:30:00 inet6 ::1/128 scope host 09:30:00 valid_lft forever preferred_lft forever 09:30:00 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 09:30:00 link/ether fa:16:3e:2f:02:6d brd ff:ff:ff:ff:ff:ff 09:30:00 altname enp0s3 09:30:00 inet 10.30.171.41/23 metric 100 brd 10.30.171.255 scope global dynamic ens3 09:30:00 valid_lft 75497sec preferred_lft 75497sec 09:30:00 inet6 fe80::f816:3eff:fe2f:26d/64 scope link 09:30:00 valid_lft forever preferred_lft forever 09:30:00 3: docker0: mtu 1458 qdisc noqueue state DOWN group default 09:30:00 link/ether 12:3b:91:de:6a:21 brd ff:ff:ff:ff:ff:ff 09:30:00 inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 09:30:00 valid_lft forever preferred_lft forever 09:30:00 09:30:00 09:30:00 ---> sar -b -r -n DEV: 09:30:00 Linux 5.15.0-153-generic (prd-ubuntu2204-docker-4c-4g-2223) 10/26/25 _x86_64_ (4 CPU) 09:30:00 09:30:00 06:28:20 LINUX RESTART (4 CPU) 09:30:00 09:30:00 06:30:05 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 09:30:00 06:40:09 7.21 0.76 6.00 0.45 538.86 1585.79 8531.82 09:30:00 06:50:09 1.66 0.01 1.64 0.01 0.07 18.52 0.09 09:30:00 07:00:10 1.36 0.00 1.35 0.01 0.00 15.75 0.11 09:30:00 07:10:25 1.51 0.00 1.49 0.01 0.00 16.82 0.12 09:30:00 07:20:04 12.45 0.01 1.53 10.91 0.32 17.38 249790.76 09:30:00 07:30:26 1.34 0.00 1.33 0.00 0.00 15.26 0.03 09:30:00 07:40:26 1.31 0.00 1.30 0.00 0.00 15.18 0.01 09:30:00 07:50:10 1.27 0.00 1.27 0.00 0.00 14.70 0.00 09:30:00 08:00:27 1.33 0.00 1.33 0.00 0.00 15.41 0.00 09:30:00 08:10:28 1.32 0.00 1.31 0.00 0.04 15.40 27.28 09:30:00 08:20:10 1.36 0.00 1.36 0.00 0.00 34.77 0.00 09:30:00 08:30:28 1.40 0.00 1.40 0.00 0.00 16.11 0.00 09:30:00 08:40:11 1.39 0.00 1.39 0.00 0.00 15.83 0.00 09:30:00 08:50:10 1.41 0.00 1.41 0.00 0.00 15.85 0.00 09:30:00 09:00:28 1.34 0.00 1.34 0.00 0.00 15.03 0.00 09:30:00 09:10:30 1.37 0.00 1.37 0.00 0.00 15.38 0.00 09:30:00 09:20:31 1.37 0.00 1.37 0.00 0.00 15.34 0.00 09:30:00 Average: 2.35 0.05 1.66 0.65 31.86 109.70 14654.10 09:30:00 09:30:00 06:30:05 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 09:30:00 06:40:09 13026380 15567268 413496 2.53 92380 2643532 975464 5.60 470028 2560532 32 09:30:00 06:50:09 13024320 15565780 414920 2.53 92920 2643548 975528 5.60 470576 2560672 4 09:30:00 07:00:10 13024276 15566248 414504 2.53 93412 2643560 975528 5.60 471064 2561556 228 09:30:00 07:10:25 13025948 15568640 412116 2.52 94008 2643696 975656 5.60 471644 2564308 8 09:30:00 07:20:04 13020648 15568908 411708 2.51 94756 2648484 975704 5.60 477136 2564888 188 09:30:00 07:30:26 13019388 15568192 412356 2.52 95172 2648628 975656 5.60 477528 2566548 8 09:30:00 07:40:26 13018128 15567352 413180 2.52 95572 2648628 975656 5.60 477936 2568312 8 09:30:00 07:50:10 13017376 15567084 413588 2.53 95900 2648772 975656 5.60 478280 2568324 4 09:30:00 08:00:27 13016648 15566864 413784 2.53 96284 2648908 975704 5.60 478648 2570960 200 09:30:00 08:10:28 12979764 15530412 450204 2.75 96676 2648932 992840 5.70 479172 2614504 5712 09:30:00 08:20:10 12977024 15528052 452612 2.76 97044 2648940 992808 5.70 479540 2613768 152 09:30:00 08:30:28 12976744 15528204 452468 2.76 97480 2648952 992872 5.70 479952 2614952 8 09:30:00 08:40:11 12975600 15527568 453040 2.77 97824 2649092 992936 5.70 480320 2615388 136 09:30:00 08:50:10 12974368 15526856 453756 2.77 98204 2649224 990512 5.69 480700 2613600 136 09:30:00 09:00:28 12972860 15525660 454996 2.78 98508 2649236 990528 5.69 480996 2614320 148 09:30:00 09:10:30 12971096 15524184 456412 2.79 98800 2649240 990512 5.69 481268 2615536 12 09:30:00 09:20:31 12969840 15523360 457256 2.79 99088 2649380 990512 5.69 481568 2616424 8 09:30:00 Average: 12999436 15548272 432376 2.64 96119 2647691 983181 5.64 477433 2588505 411 09:30:00 09:30:00 06:30:05 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 09:30:00 06:40:09 lo 0.14 0.14 0.02 0.02 0.00 0.00 0.00 0.00 09:30:00 06:40:09 ens3 6.72 3.53 134.19 0.97 0.00 0.00 0.00 0.00 09:30:00 06:40:09 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 06:50:09 lo 0.10 0.10 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 06:50:09 ens3 0.23 0.08 0.04 0.02 0.00 0.00 0.00 0.00 09:30:00 06:50:09 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 07:00:10 lo 0.10 0.10 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 07:00:10 ens3 0.22 0.08 0.04 0.02 0.00 0.00 0.00 0.00 09:30:00 07:00:10 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 07:10:25 lo 0.12 0.12 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 07:10:25 ens3 0.37 0.14 0.10 0.06 0.00 0.00 0.00 0.00 09:30:00 07:10:25 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 07:20:04 lo 0.08 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 07:20:04 ens3 0.29 0.09 0.08 0.04 0.00 0.00 0.00 0.00 09:30:00 07:20:04 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 07:30:26 lo 0.12 0.12 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 07:30:26 ens3 0.24 0.08 0.04 0.02 0.00 0.00 0.00 0.00 09:30:00 07:30:26 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 07:40:26 lo 0.10 0.10 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 07:40:26 ens3 0.35 0.13 0.10 0.06 0.00 0.00 0.00 0.00 09:30:00 07:40:26 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 07:50:10 lo 0.08 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 07:50:10 ens3 0.21 0.07 0.04 0.02 0.00 0.00 0.00 0.00 09:30:00 07:50:10 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 08:00:27 lo 0.12 0.12 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 08:00:27 ens3 0.30 0.11 0.07 0.04 0.00 0.00 0.00 0.00 09:30:00 08:00:27 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 08:10:28 lo 0.10 0.10 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 08:10:28 ens3 5.96 2.36 10.32 0.94 0.00 0.00 0.00 0.00 09:30:00 08:10:28 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 08:20:10 lo 0.08 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 08:20:10 ens3 0.41 0.07 0.07 0.02 0.00 0.00 0.00 0.00 09:30:00 08:20:10 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 08:30:28 lo 0.12 0.12 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 08:30:28 ens3 0.59 0.09 0.09 0.02 0.00 0.00 0.00 0.00 09:30:00 08:30:28 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 08:40:11 lo 0.08 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 08:40:11 ens3 0.71 0.16 0.16 0.08 0.00 0.00 0.00 0.00 09:30:00 08:40:11 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 08:50:10 lo 0.10 0.10 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 08:50:10 ens3 0.29 0.08 0.05 0.02 0.00 0.00 0.00 0.00 09:30:00 08:50:10 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 09:00:28 lo 0.10 0.10 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 09:00:28 ens3 0.30 0.08 0.05 0.02 0.00 0.00 0.00 0.00 09:30:00 09:00:28 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 09:10:30 lo 0.12 0.12 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 09:10:30 ens3 0.29 0.10 0.07 0.04 0.00 0.00 0.00 0.00 09:30:00 09:10:30 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 09:20:31 lo 0.08 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 09:20:31 ens3 0.41 0.12 0.11 0.06 0.00 0.00 0.00 0.00 09:30:00 09:20:31 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 Average: lo 0.10 0.10 0.01 0.01 0.00 0.00 0.00 0.00 09:30:00 Average: ens3 1.05 0.44 8.60 0.14 0.00 0.00 0.00 0.00 09:30:00 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:30:00 09:30:00 09:30:00 ---> sar -P ALL: 09:30:00 Linux 5.15.0-153-generic (prd-ubuntu2204-docker-4c-4g-2223) 10/26/25 _x86_64_ (4 CPU) 09:30:00 09:30:00 06:28:20 LINUX RESTART (4 CPU) 09:30:00 09:30:00 06:30:05 CPU %user %nice %system %iowait %steal %idle 09:30:00 06:40:09 all 0.59 0.00 0.15 0.14 0.02 99.10 09:30:00 06:40:09 0 0.42 0.00 0.14 0.11 0.01 99.33 09:30:00 06:40:09 1 0.28 0.00 0.17 0.29 0.02 99.24 09:30:00 06:40:09 2 1.05 0.00 0.12 0.03 0.03 98.77 09:30:00 06:40:09 3 0.60 0.00 0.17 0.13 0.02 99.08 09:30:00 06:50:09 all 0.26 0.00 0.02 0.01 0.02 99.69 09:30:00 06:50:09 0 0.01 0.00 0.01 0.02 0.00 99.95 09:30:00 06:50:09 1 0.73 0.00 0.02 0.00 0.03 99.21 09:30:00 06:50:09 2 0.02 0.00 0.02 0.00 0.02 99.94 09:30:00 06:50:09 3 0.29 0.00 0.02 0.00 0.01 99.67 09:30:00 07:00:10 all 0.10 0.00 0.02 0.01 0.02 99.86 09:30:00 07:00:10 0 0.01 0.00 0.01 0.02 0.00 99.96 09:30:00 07:00:10 1 0.36 0.00 0.01 0.00 0.02 99.60 09:30:00 07:00:10 2 0.03 0.00 0.03 0.00 0.03 99.91 09:30:00 07:00:10 3 0.01 0.00 0.02 0.00 0.01 99.96 09:30:00 07:10:25 all 0.10 0.00 0.02 0.01 0.02 99.86 09:30:00 07:10:25 0 0.01 0.00 0.01 0.02 0.01 99.94 09:30:00 07:10:25 1 0.33 0.00 0.02 0.00 0.02 99.64 09:30:00 07:10:25 2 0.01 0.00 0.02 0.00 0.02 99.95 09:30:00 07:10:25 3 0.03 0.00 0.03 0.00 0.03 99.91 09:30:00 07:20:04 all 0.15 0.00 0.02 0.03 0.02 99.78 09:30:00 07:20:04 0 0.01 0.00 0.02 0.02 0.00 99.95 09:30:00 07:20:04 1 0.01 0.00 0.02 0.09 0.02 99.86 09:30:00 07:20:04 2 0.03 0.00 0.03 0.00 0.03 99.90 09:30:00 07:20:04 3 0.56 0.00 0.02 0.00 0.02 99.40 09:30:00 07:30:26 all 0.18 0.00 0.02 0.01 0.02 99.78 09:30:00 07:30:26 0 0.02 0.00 0.02 0.01 0.01 99.94 09:30:00 07:30:26 1 0.01 0.00 0.02 0.00 0.02 99.95 09:30:00 07:30:26 2 0.02 0.00 0.03 0.00 0.03 99.92 09:30:00 07:30:26 3 0.65 0.00 0.01 0.01 0.01 99.32 09:30:00 07:40:26 all 0.09 0.00 0.02 0.01 0.02 99.86 09:30:00 07:40:26 0 0.19 0.00 0.01 0.00 0.01 99.79 09:30:00 07:40:26 1 0.02 0.00 0.03 0.01 0.03 99.90 09:30:00 07:40:26 2 0.01 0.00 0.02 0.00 0.01 99.95 09:30:00 07:40:26 3 0.14 0.00 0.02 0.01 0.02 99.81 09:30:00 07:50:10 all 0.22 0.00 0.02 0.01 0.02 99.73 09:30:00 07:50:10 0 0.02 0.00 0.02 0.00 0.01 99.96 09:30:00 07:50:10 1 0.01 0.00 0.01 0.02 0.02 99.94 09:30:00 07:50:10 2 0.01 0.00 0.01 0.01 0.02 99.96 09:30:00 07:50:10 3 0.85 0.00 0.04 0.00 0.04 99.07 09:30:00 08:00:27 all 0.06 0.00 0.02 0.01 0.02 99.90 09:30:00 08:00:27 0 0.02 0.00 0.01 0.01 0.00 99.95 09:30:00 08:00:27 1 0.01 0.00 0.01 0.00 0.02 99.95 09:30:00 08:00:27 2 0.01 0.00 0.02 0.01 0.01 99.94 09:30:00 08:00:27 3 0.18 0.00 0.03 0.00 0.03 99.75 09:30:00 08:10:28 all 0.27 0.00 0.03 0.01 0.02 99.68 09:30:00 08:10:28 0 0.02 0.00 0.02 0.02 0.01 99.93 09:30:00 08:10:28 1 0.11 0.00 0.03 0.00 0.03 99.83 09:30:00 08:10:28 2 0.68 0.00 0.04 0.01 0.02 99.25 09:30:00 08:10:28 3 0.25 0.00 0.03 0.00 0.01 99.70 09:30:00 08:20:10 all 0.12 0.00 0.02 0.01 0.02 99.83 09:30:00 08:20:10 0 0.10 0.00 0.01 0.02 0.01 99.87 09:30:00 08:20:10 1 0.01 0.00 0.03 0.01 0.03 99.92 09:30:00 08:20:10 2 0.36 0.00 0.03 0.00 0.03 99.57 09:30:00 08:20:10 3 0.01 0.00 0.02 0.00 0.01 99.95 09:30:00 09:30:00 08:20:10 CPU %user %nice %system %iowait %steal %idle 09:30:00 08:30:28 all 0.16 0.00 0.02 0.01 0.02 99.79 09:30:00 08:30:28 0 0.02 0.00 0.01 0.01 0.00 99.95 09:30:00 08:30:28 1 0.43 0.00 0.02 0.02 0.03 99.51 09:30:00 08:30:28 2 0.18 0.00 0.03 0.02 0.02 99.75 09:30:00 08:30:28 3 0.01 0.00 0.02 0.00 0.01 99.95 09:30:00 08:40:11 all 0.09 0.00 0.02 0.01 0.02 99.86 09:30:00 08:40:11 0 0.01 0.00 0.02 0.01 0.01 99.96 09:30:00 08:40:11 1 0.23 0.00 0.03 0.00 0.04 99.70 09:30:00 08:40:11 2 0.12 0.00 0.02 0.02 0.02 99.82 09:30:00 08:40:11 3 0.01 0.00 0.01 0.01 0.01 99.96 09:30:00 08:50:10 all 0.13 0.00 0.02 0.01 0.02 99.83 09:30:00 08:50:10 0 0.01 0.00 0.01 0.02 0.01 99.95 09:30:00 08:50:10 1 0.48 0.00 0.02 0.00 0.03 99.46 09:30:00 08:50:10 2 0.01 0.00 0.02 0.01 0.03 99.93 09:30:00 08:50:10 3 0.01 0.00 0.01 0.00 0.01 99.97 09:30:00 09:00:28 all 0.09 0.00 0.02 0.01 0.02 99.86 09:30:00 09:00:28 0 0.01 0.00 0.02 0.02 0.01 99.94 09:30:00 09:00:28 1 0.31 0.00 0.03 0.00 0.04 99.62 09:30:00 09:00:28 2 0.02 0.00 0.03 0.00 0.02 99.93 09:30:00 09:00:28 3 0.02 0.00 0.01 0.00 0.01 99.96 09:30:00 09:10:30 all 0.02 0.00 0.02 0.01 0.02 99.94 09:30:00 09:10:30 0 0.02 0.00 0.01 0.01 0.01 99.95 09:30:00 09:10:30 1 0.02 0.00 0.02 0.01 0.04 99.91 09:30:00 09:10:30 2 0.02 0.00 0.02 0.01 0.02 99.93 09:30:00 09:10:30 3 0.01 0.00 0.01 0.00 0.01 99.97 09:30:00 09:20:31 all 0.19 0.00 0.02 0.01 0.02 99.76 09:30:00 09:20:31 0 0.69 0.00 0.01 0.00 0.01 99.28 09:30:00 09:20:31 1 0.02 0.00 0.04 0.00 0.03 99.91 09:30:00 09:20:31 2 0.03 0.00 0.02 0.02 0.02 99.91 09:30:00 09:20:31 3 0.01 0.00 0.02 0.00 0.01 99.96 09:30:00 Average: all 0.17 0.00 0.03 0.02 0.02 99.77 09:30:00 Average: 0 0.09 0.00 0.02 0.02 0.01 99.86 09:30:00 Average: 1 0.20 0.00 0.03 0.03 0.03 99.71 09:30:00 Average: 2 0.16 0.00 0.03 0.01 0.02 99.78 09:30:00 Average: 3 0.22 0.00 0.03 0.01 0.02 99.73 09:30:00 09:30:00 09:30:00