Total Statistics | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
All Tests | 33 | 6 | 27 | 0 | 00:12:52 |
Statistics by Tag | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
critical | 6 | 4 | 2 | 0 | 00:02:22 | |
| 2 | 0 | 2 | 0 | 00:02:01 | |
| 1 | 0 | 1 | 0 | 00:00:00 | |
odlmicro_ign | 2 | 2 | 0 | 0 | 00:00:22 |
Statistics by Suite | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
33 | 6 | 27 | 0 | 00:13:16 | ||
6 | 6 | 0 | 0 | 00:00:32 | ||
6 | 6 | 0 | 0 | 00:00:32 | ||
7 | 0 | 7 | 0 | 00:01:08 | ||
10 | 0 | 10 | 0 | 00:00:05 | ||
6 | 0 | 6 | 0 | 00:08:07 | ||
4 | 0 | 4 | 0 | 00:03:25 |
Full Name: | netconf-scale.txt |
---|---|
Start / End / Elapsed: | 20240908 03:14:14.397 / 20240908 03:27:30.365 / 00:13:15.968 |
Status: | 33 tests total, 6 passed, 27 failed, 0 skipped |
Full Name: | netconf-scale.txt.Ready |
---|---|
Source: | /w/workspace/netconf-csit-1node-scale-only-scandium/test/csit/suites/netconf/ready |
Start / End / Elapsed: | 20240908 03:14:14.419 / 20240908 03:14:46.105 / 00:00:31.686 |
Status: | 6 tests total, 6 passed, 0 failed, 0 skipped |
Full Name: | netconf-scale.txt.Performance |
---|---|
Documentation: | netconf-restperfclient Update performance test suite. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform given count of update operations on device data mounted onto a netconf connector (using the netconf-testtool-restperfclient tool) and see how much time it took. More exactly, it sends the data to a restconf mountpoint of the netconf connector belonging to the device, which turns out to turn the first request sent to a "create" request and the remaining requests to "update" requests (due to how the testtool device behavior is implemented). |
Source: | /w/workspace/netconf-csit-1node-scale-only-scandium/test/csit/suites/netconf/restperfclient/performance.robot |
Start / End / Elapsed: | 20240908 03:14:46.106 / 20240908 03:15:53.788 / 00:01:07.682 |
Status: | 7 tests total, 0 passed, 7 failed, 0 skipped |
Documentation: | Setup everything needed for the test cases. |
---|---|
Start / End / Elapsed: | 20240908 03:14:46.205 / 20240908 03:14:52.028 / 00:00:05.823 |
Documentation: | Teardown the test infrastructure, perform cleanup and release all resources. |
---|---|
Start / End / Elapsed: | 20240908 03:15:53.770 / 20240908 03:15:53.787 / 00:00:00.017 |
Full Name: | netconf-scale.txt.Performance.Start_Testtool |
---|---|
Documentation: | Deploy and start test tool, then wait for all its devices to become online. |
Start / End / Elapsed: | 20240908 03:14:52.028 / 20240908 03:15:53.605 / 00:01:01.577 |
Status: | FAIL |
Message: |
Full Name: | netconf-scale.txt.Performance.Configure_Device_On_Netconf |
---|---|
Documentation: | Configure the testtool device on Netconf connector. |
Start / End / Elapsed: | 20240908 03:15:53.605 / 20240908 03:15:53.618 / 00:00:00.013 |
Status: | FAIL |
Message: |
Full Name: | netconf-scale.txt.Performance.Wait_For_Device_To_Become_Connected |
---|---|
Documentation: | Wait until the device becomes available through Netconf. |
Start / End / Elapsed: | 20240908 03:15:53.618 / 20240908 03:15:53.631 / 00:00:00.013 |
Status: | FAIL |
Message: |
Full Name: | netconf-scale.txt.Performance.Create_Device_Data |
---|---|
Documentation: | Send some sample test data into the device and check that the request went OK. |
Start / End / Elapsed: | 20240908 03:15:53.631 / 20240908 03:15:53.644 / 00:00:00.013 |
Status: | FAIL |
Message: |
Full Name: | netconf-scale.txt.Performance.Run_Restperfclient |
---|---|
Documentation: | Deploy and execute restperfclient, asking it to send the specified amount of requests to the netconf connector of the device. |
Start / End / Elapsed: | 20240908 03:15:53.644 / 20240908 03:15:53.657 / 00:00:00.013 |
Status: | FAIL |
Message: |
Full Name: | netconf-scale.txt.Performance.Check_For_Failed_Requests |
---|---|
Documentation: | Make sure there are no failed requests in the restperfclient log. This is a separate test case to distinguish between restperfclient failure and failed requests. Failed requests are rejected because we don't want to test performance of ODL rejecting our requests. |
Start / End / Elapsed: | 20240908 03:15:53.657 / 20240908 03:15:53.670 / 00:00:00.013 |
Status: | FAIL |
Message: |
Full Name: | netconf-scale.txt.Mdsal |
---|---|
Documentation: | netconf-restperfclient MDSAL performance test suite. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform given count of update operations on ODL MDSAL. In first half the requests are directed directly to MDSAL via Restconf and in the second half the MDSAL is mounted onto a netconf connector and the reqursts are directed to that connector. In both cases the netconf-testtool-restperfclient tool is used to generate and send the requests and the requests are sent synchronously as the netconf connector mounted MDSAL does not support asynchronous requests. The restperfclient is used to generate the "update" requests, the "create" request is issued in a sepate test case. |
Source: | /w/workspace/netconf-csit-1node-scale-only-scandium/test/csit/suites/netconf/restperfclient/mdsal.robot |
Start / End / Elapsed: | 20240908 03:15:53.789 / 20240908 03:15:58.466 / 00:00:04.677 |
Status: | 10 tests total, 0 passed, 10 failed, 0 skipped |
Full Name: | netconf-scale.txt.Getmulti |
---|---|
Documentation: | netconf-connector scaling test suite (multi-threaded GET requests). Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Performs scaling tests:
(using external Python tool).
|
Source: | /w/workspace/netconf-csit-1node-scale-only-scandium/test/csit/suites/netconf/scale/getmulti.robot |
Start / End / Elapsed: | 20240908 03:15:58.467 / 20240908 03:24:05.599 / 00:08:07.132 |
Status: | 6 tests total, 0 passed, 6 failed, 0 skipped |
Full Name: | netconf-scale.txt.Getsingle |
---|---|
Documentation: | netconf-connector scaling test suite (single-threaded GET requests). Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Performs scaling tests:
|
Source: | /w/workspace/netconf-csit-1node-scale-only-scandium/test/csit/suites/netconf/scale/getsingle.robot |
Start / End / Elapsed: | 20240908 03:24:05.599 / 20240908 03:27:30.363 / 00:03:24.764 |
Status: | 4 tests total, 0 passed, 4 failed, 0 skipped |