Total Statistics | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
All Tests | 138 | 62 | 76 | 0 | 00:04:42 |
Statistics by Tag | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
critical | 31 | 9 | 22 | 0 | 00:00:09 | |
| 1 | 0 | 1 | 0 | 00:00:00 | |
odlmicro_ign | 4 | 1 | 3 | 0 | 00:00:28 |
Statistics by Suite | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
138 | 62 | 76 | 0 | 00:05:43 | ||
6 | 4 | 2 | 0 | 00:00:32 | ||
6 | 4 | 2 | 0 | 00:00:32 | ||
1 | 0 | 1 | 0 | 00:00:00 | ||
1 | 0 | 1 | 0 | 00:00:00 | ||
49 | 49 | 0 | 0 | 00:00:12 | ||
49 | 49 | 0 | 0 | 00:00:12 | ||
58 | 6 | 52 | 0 | 00:03:44 | ||
29 | 3 | 26 | 0 | 00:01:49 | ||
29 | 3 | 26 | 0 | 00:01:55 | ||
11 | 0 | 11 | 0 | 00:00:02 | ||
11 | 0 | 11 | 0 | 00:00:02 | ||
8 | 1 | 7 | 0 | 00:00:24 | ||
8 | 1 | 7 | 0 | 00:00:24 | ||
5 | 2 | 3 | 0 | 00:00:48 | ||
5 | 2 | 3 | 0 | 00:00:48 |
Full Name: | netconf-gate-userfeatures.txt |
---|---|
Start / End / Elapsed: | 20240928 23:23:58.076 / 20240928 23:29:41.185 / 00:05:43.109 |
Status: | 138 tests total, 62 passed, 76 failed, 0 skipped |
Full Name: | netconf-gate-userfeatures.txt.Ready |
---|---|
Source: | /w/workspace/netconf-csit-1node-gate-userfeatures-all-titanium/test/csit/suites/netconf/ready |
Start / End / Elapsed: | 20240928 23:23:58.097 / 20240928 23:24:30.480 / 00:00:32.383 |
Status: | 6 tests total, 4 passed, 2 failed, 0 skipped |
Full Name: | netconf-gate-userfeatures.txt.Ready.Netconfready |
---|---|
Documentation: | netconf-connector readiness test suite. Copyright (c) 2015,2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Try to detect whether Netconf is up and running and wait for it for a configurable time if it is not yet up and running. This is achieved by the test Check_Whether_Netconf_Topology_Is_Ready. This test case does not use controller-config device. This test case is skipped (Pass Execution) if the usage of controller-config device is indicated. Testing itself is done by creating a netconf test device configured to all odl nodes one by one and check if GET works from mounted device. GET is done from all the odl nodes and it works for both, 1 or 3 nodes setup. The next test cases are basically dedicated to test readiness of the netconf using controller-config device. This device is created when odl-netconf-connector-ssh|all feature is installed. Robot variable USE_NETCONF_CONNECTOR should be set to True. Connector test cases change behavior depending on False. If True, they check data mounted behind controller-config is readable, if False they only check topology-netconf is readable. Some testsuites expect netconf-connector to be ready as soon as possible and will fail if it is not. We want to see a failure if this is the cause of the failure. The usage of netconf-connector happens in other suites than netconf, especially bgpcep to configure odl's bgp peers. Testing the readiness of the netconf-connector must be invoked by the Robot invocation argument USE_NETCONF_CONNECTOR. By default it is set to False and test jobs should be responsible to set it to True if needed. In the default configuration the affected test cases waits for the netconf topology to appear only. If the netconf-connector is not ready upon startup and it's usage is set to True (as seen by the second test case failing), the next case starts to repeat the query for a minute to see whether it is going "to fix itself" within the minute. If yes, then the testcase will pass, which indicates that the "ODL cooldown" of 1 minute is not long enough to allow for netconf-connector to initialize properly. If this fails, one more check with even longer timeout is run. If the Check_Whether_Netconf_Is_Up_And_Running pass, then the next test case does nothing. The other test case then checks whether Netconf can pretty print data. This sometimes makes problems, most likely due to too new Robot Requests library with an interface incompatible with this test suite. |
Source: | /w/workspace/netconf-csit-1node-gate-userfeatures-all-titanium/test/csit/suites/netconf/ready/netconfready.robot |
Start / End / Elapsed: | 20240928 23:23:58.099 / 20240928 23:24:30.480 / 00:00:32.381 |
Status: | 6 tests total, 4 passed, 2 failed, 0 skipped |
Documentation: | Initialize SetupUtils. Setup requests library and log into karaf.log that the netconf readiness wait starts. |
---|---|
Start / End / Elapsed: | 20240928 23:23:58.587 / 20240928 23:24:01.650 / 00:00:03.063 |
Documentation: | Destroy all sessions in the requests library and log into karaf.log that the netconf readiness wait is over. |
---|---|
Start / End / Elapsed: | 20240928 23:24:30.405 / 20240928 23:24:30.479 / 00:00:00.074 |
Full Name: | netconf-gate-userfeatures.txt.Ready.Netconfready.Check_Whether_Netconf_Topology_Is_Ready |
---|---|
Documentation: | Checks netconf readiness. |
Tags: | odlmicro_ign |
Start / End / Elapsed: | 20240928 23:24:01.650 / 20240928 23:24:13.932 / 00:00:12.282 |
Status: | FAIL |
Message: |
Full Name: | netconf-gate-userfeatures.txt.Ready.Netconfready.Wait_For_Netconf_Connector |
---|---|
Documentation: | Wait for the Netconf to go up for configurable time. |
Tags: | critical |
Start / End / Elapsed: | 20240928 23:24:13.932 / 20240928 23:24:14.520 / 00:00:00.588 |
Status: | PASS |
Full Name: | netconf-gate-userfeatures.txt.Ready.Netconfready.Wait_Even_Longer |
---|---|
Documentation: | Bugs such as 7175 may require to wait longer till netconf-connector works. |
Tags: | critical |
Start / End / Elapsed: | 20240928 23:24:14.521 / 20240928 23:24:14.661 / 00:00:00.140 |
Status: | PASS |
Message: |
Full Name: | netconf-gate-userfeatures.txt.Ready.Netconfready.Check_For_Bug_5014 |
---|---|
Documentation: | If Netconf appears to be down, it may be due to bug 5014. Check if it is so and fail if yes. Bug 5014 is about Netconf playing dead on boot until a device configuration request is sent to it. To uncover this attempt to configure and then deconfigure a device and then check if Netconf is now up and running. If that turns out to be true, fail the case as this signifies the bug 5014 to be present. Skip this testcase if Netconf is detected to be up and running. |
Tags: | critical |
Start / End / Elapsed: | 20240928 23:24:14.661 / 20240928 23:24:14.799 / 00:00:00.138 |
Status: | PASS |
Message: |
Full Name: | netconf-gate-userfeatures.txt.Ready.Netconfready.Check_Whether_Netconf_Can_Pretty_Print |
---|---|
Documentation: | Make one request to netconf-connector and see if it works. |
Tags: | critical |
Start / End / Elapsed: | 20240928 23:24:14.798 / 20240928 23:24:14.975 / 00:00:00.177 |
Status: | FAIL |
Message: |
Full Name: | netconf-gate-userfeatures.txt.Apidocs |
---|---|
Source: | /w/workspace/netconf-csit-1node-gate-userfeatures-all-titanium/test/csit/suites/netconf/apidocs |
Start / End / Elapsed: | 20240928 23:24:30.481 / 20240928 23:24:30.560 / 00:00:00.079 |
Status: | 1 test total, 0 passed, 1 failed, 0 skipped |
Full Name: | netconf-gate-userfeatures.txt.MDSAL |
---|---|
Source: | /w/workspace/netconf-csit-1node-gate-userfeatures-all-titanium/test/csit/suites/netconf/MDSAL |
Start / End / Elapsed: | 20240928 23:24:30.561 / 20240928 23:24:42.938 / 00:00:12.377 |
Status: | 49 tests total, 49 passed, 0 failed, 0 skipped |
Full Name: | netconf-gate-userfeatures.txt.CRUD |
---|---|
Source: | /w/workspace/netconf-csit-1node-gate-userfeatures-all-titanium/test/csit/suites/netconf/CRUD |
Start / End / Elapsed: | 20240928 23:24:42.938 / 20240928 23:28:26.637 / 00:03:43.699 |
Status: | 58 tests total, 6 passed, 52 failed, 0 skipped |
Full Name: | netconf-gate-userfeatures.txt.CRUD-ACTION |
---|---|
Source: | /w/workspace/netconf-csit-1node-gate-userfeatures-all-titanium/test/csit/suites/netconf/CRUD-ACTION |
Start / End / Elapsed: | 20240928 23:28:26.638 / 20240928 23:28:28.910 / 00:00:02.272 |
Status: | 11 tests total, 0 passed, 11 failed, 0 skipped |
Full Name: | netconf-gate-userfeatures.txt.Notifications |
---|---|
Source: | /w/workspace/netconf-csit-1node-gate-userfeatures-all-titanium/test/csit/suites/netconf/notifications |
Start / End / Elapsed: | 20240928 23:28:28.910 / 20240928 23:28:52.715 / 00:00:23.805 |
Status: | 8 tests total, 1 passed, 7 failed, 0 skipped |
Full Name: | netconf-gate-userfeatures.txt.KeyAuth |
---|---|
Source: | /w/workspace/netconf-csit-1node-gate-userfeatures-all-titanium/test/csit/suites/netconf/KeyAuth |
Start / End / Elapsed: | 20240928 23:28:52.715 / 20240928 23:29:41.183 / 00:00:48.468 |
Status: | 5 tests total, 2 passed, 3 failed, 0 skipped |