Total Statistics | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
All Tests | 392 | 364 | 28 | 0 | 00:18:31 |
Statistics by Tag | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
critical | 149 | 130 | 19 | 0 | 00:09:44 | |
| 1 | 0 | 1 | 0 | 00:00:21 | |
| 1 | 0 | 1 | 0 | 00:00:21 | |
local_run | 1 | 1 | 0 | 0 | 00:00:00 |
Statistics by Suite | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
392 | 364 | 28 | 0 | 00:19:50 | ||
4 | 4 | 0 | 0 | 00:00:07 | ||
16 | 16 | 0 | 0 | 00:00:05 | ||
2 | 2 | 0 | 0 | 00:00:28 | ||
38 | 38 | 0 | 0 | 00:01:18 | ||
36 | 30 | 6 | 0 | 00:02:25 | ||
4 | 4 | 0 | 0 | 00:00:36 | ||
28 | 28 | 0 | 0 | 00:00:46 | ||
36 | 36 | 0 | 0 | 00:01:12 | ||
22 | 15 | 7 | 0 | 00:02:31 | ||
5 | 5 | 0 | 0 | 00:00:13 | ||
12 | 12 | 0 | 0 | 00:00:39 | ||
9 | 9 | 0 | 0 | 00:00:19 | ||
78 | 78 | 0 | 0 | 00:02:55 | ||
6 | 4 | 2 | 0 | 00:00:46 | ||
4 | 2 | 2 | 0 | 00:00:51 | ||
29 | 29 | 0 | 0 | 00:01:20 | ||
10 | 10 | 0 | 0 | 00:00:21 | ||
14 | 14 | 0 | 0 | 00:00:32 | ||
11 | 8 | 3 | 0 | 00:00:17 | ||
8 | 7 | 1 | 0 | 00:00:21 | ||
20 | 13 | 7 | 0 | 00:01:48 |
Full Name: | bgpcep-userfeatures.txt |
---|---|
Start / End / Elapsed: | 20241121 04:06:23.929 / 20241121 04:26:14.412 / 00:19:50.483 |
Status: | 392 tests total, 364 passed, 28 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.050 Bmp Basic |
---|---|
Documentation: | Basic tests for odl-bgpcep-bmp feature Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This is a basic suite for bgp monitoring protocol feature. After the feature odl-bgpcep-bmp installation the port 12345 should be bound for listening, To test this feature bgp-bmp-mock tool is used. It is a part of the bgpcep project. It is a java tool which simulates more peers and more routers. In this particular test suite it simulates 1 peer with 1 router, which means it advertizes one peer ipv4 address towards odl. As a result one route should appear in the rests/data/bmp-monitor:bmp-monitor?content=nonconfig. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/050_bmp_basic.robot |
Start / End / Elapsed: | 20241121 04:06:23.962 / 20241121 04:06:30.829 / 00:00:06.867 |
Status: | 4 tests total, 4 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Pcepuser |
---|---|
Documentation: | Basic tests for odl-bgpcep-pcep-all feature. Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/pcepuser/pcepuser.robot |
Start / End / Elapsed: | 20241121 04:06:30.831 / 20241121 04:06:36.028 / 00:00:05.197 |
Status: | 16 tests total, 16 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Bgp Functional Md5 |
---|---|
Documentation: | Functional test suite for bgp - n-path and all-path selection Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests tcpmd5 connection of bgp peers. It uses odl and exabgp as bgp peer. No routes are advertized, simple peer presence in the datastore is tested. are configured via application peer. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/bgp_functional_md5.robot |
Start / End / Elapsed: | 20241121 04:06:36.028 / 20241121 04:07:04.245 / 00:00:28.217 |
Status: | 2 tests total, 2 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Basic |
---|---|
Documentation: | Basic tests for odl-bgpcep-bgp-all feature. Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Test suite performs basic BGP functional test cases: BGP peer initiated connection
ODL controller initiated connection:
in another update while the very first prefix is withdrawn
(to be ignored by controller) in a single update message TC_R (test case reset) tests session-reset functionality. Resets the session, and than verifies that example-ipv4-topology is empty again. TC_LA (test case local address) tests configuration of internal peer with local-address configured
with tools_system_ip
TC_PG (test case peer group) tests configuration and reconfiguration of peer-groups and neighbors configured by them.
Brief description how to perform BGP functional test: https://wiki.opendaylight.org/view/BGP_LS_PCEP:Lithium_Feature_Tests#How_to_test_2 |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpuser/basic.robot |
Start / End / Elapsed: | 20241121 04:07:04.246 / 20241121 04:08:22.088 / 00:01:17.842 |
Status: | 38 tests total, 38 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic |
---|---|
Documentation: | Functional test for ipv6 connection with bgp. Copyright (c) 2018 AT&T Intellectual Property. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests simple connection between one ibgp peer (exabgp) and Odl. Peer is configured with ipv6, and exabgp connectes to odl via ipv6. Exabgp sends one ipv6 unicast route, which presence is verified in example-ipv6-topology. Tests this connection multiple times, with different ipv6 accepted formats, e.g. (::1, 0:0:0:0:0:0:0:1, full text) This suite also tests a combination of afi-safis on odl and exabgp. ipv6 route injection is carried out from odl to the ibgp peer without ipv6 family enabled on the peer device and checked for exceptions |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/bgp_ipv6_basic.robot |
Start / End / Elapsed: | 20241121 04:08:22.089 / 20241121 04:10:46.608 / 00:02:24.519 |
Status: | 36 tests total, 30 passed, 6 failed, 0 skipped |
Documentation: | Suite setup keyword. |
---|---|
Start / End / Elapsed: | 20241121 04:08:22.178 / 20241121 04:08:29.378 / 00:00:07.200 |
Documentation: | Suite teardown keyword |
---|---|
Start / End / Elapsed: | 20241121 04:10:46.549 / 20241121 04:10:46.608 / 00:00:00.059 |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Reconfigure_ODL_To_Accept_Connections |
---|---|
Documentation: | Configure BGP peer modules with initiate-connection set to false with short ipv6 address. |
Start / End / Elapsed: | 20241121 04:08:29.378 / 20241121 04:08:29.726 / 00:00:00.348 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Start_Exabgp |
---|---|
Documentation: | Start exabgp with |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:08:29.726 / 20241121 04:08:48.503 / 00:00:18.777 |
Status: | FAIL |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden. |
---|---|
Start / End / Elapsed: | 20241121 04:08:29.727 / 20241121 04:08:29.807 / 00:00:00.080 |
Documentation: | Returns the given values which can then be assigned to a variables. |
---|---|
Start / End / Elapsed: | 20241121 04:08:29.807 / 20241121 04:08:29.807 / 00:00:00.000 |
Documentation: | Starts the ExaBgp and verifies its connection. The verification is done by checking the presence of the peer in the bgp rib. |
---|---|
Start / End / Elapsed: | 20241121 04:08:29.807 / 20241121 04:08:48.503 / 00:00:18.696 |
Start / End / Elapsed: | 20241121 04:08:29.810 / 20241121 04:08:48.502 / 00:00:18.692 |
---|
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Verify_Ipv6_Topology_Filled |
---|---|
Documentation: | Verifies that example-ipv6-topology is filled after starting exabgp. |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:08:48.503 / 20241121 04:08:57.808 / 00:00:09.305 |
Status: | FAIL |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden. |
---|---|
Start / End / Elapsed: | 20241121 04:08:48.504 / 20241121 04:08:48.591 / 00:00:00.087 |
Documentation: | Verifies that example-ipv6-topology is filled with ipv6 route |
---|---|
Start / End / Elapsed: | 20241121 04:08:48.591 / 20241121 04:08:57.808 / 00:00:09.217 |
Documentation: | Runs the specified keyword and retries if it fails. |
---|---|
Start / End / Elapsed: | 20241121 04:08:48.591 / 20241121 04:08:57.808 / 00:00:09.217 |
Message: |
Documentation: | Add arguments sensible for JSON data, return Get_Templated response text. Optionally, verification against JSON data (may be iterated) is called. Only subset of JSON data is verified and returned if JMES path is specified in file ${folder}/jmespath.expr. |
---|---|
Start / End / Elapsed: | 20241121 04:08:57.578 / 20241121 04:08:57.808 / 00:00:00.230 |
Documentation: | Resolve URI from folder, call Get_From_Uri, return response text. |
---|---|
Start / End / Elapsed: | 20241121 04:08:57.586 / 20241121 04:08:57.727 / 00:00:00.141 |
Start / End / Elapsed: | 20241121 04:08:57.727 / 20241121 04:08:57.807 / 00:00:00.080 |
---|
Documentation: | Resolve expected JSON data, should be equal to provided ${response}. JSON normalization is used, endlines enabled for readability. |
---|---|
Start / End / Elapsed: | 20241121 04:08:57.727 / 20241121 04:08:57.807 / 00:00:00.080 |
Documentation: | Resolve expected text from template, provided response shuld be equal. If ${normalize_json}, perform normalization before comparison. |
---|---|
Start / End / Elapsed: | 20241121 04:08:57.728 / 20241121 04:08:57.807 / 00:00:00.079 |
Documentation: | Read a template from folder, strip endline, make changes according to mapping, return the result. If ${iterations} value is present, put text together from "prolog", "item" and "epilog" parts, where additional template variable ${i} goes from 1, by one times. Template variable ${j} is calculated as ${i} incremented by offset 0 ( j = i + iter_j_offset ) used to create non uniform data in order to be able to validate UPDATE operations. POST (as opposed to PUT) needs slightly different data, ${name_prefix} may be used to distinguish. (Actually, it is GET who formats data differently when URI is a top-level container.) |
---|---|
Start / End / Elapsed: | 20241121 04:08:57.739 / 20241121 04:08:57.802 / 00:00:00.063 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20241121 04:08:57.802 / 20241121 04:08:57.804 / 00:00:00.002 |
Start / End / Elapsed: | 20241121 04:08:57.805 / 20241121 04:08:57.807 / 00:00:00.002 |
---|
Documentation: | Use norm_json to normalize both JSON arguments, call Should_Be_Equal. |
---|---|
Start / End / Elapsed: | 20241121 04:08:57.805 / 20241121 04:08:57.807 / 00:00:00.002 |
Documentation: | Attempt to return sorted indented JSON string. |
---|---|
Start / End / Elapsed: | 20241121 04:08:57.805 / 20241121 04:08:57.805 / 00:00:00.000 |
Documentation: | Attempt to return sorted indented JSON string. |
---|---|
Start / End / Elapsed: | 20241121 04:08:57.806 / 20241121 04:08:57.806 / 00:00:00.000 |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Delete_Bgp_Peer_Configuration |
---|---|
Documentation: | Revert the BGP configuration to the original state: without any configured peers. |
Start / End / Elapsed: | 20241121 04:08:57.809 / 20241121 04:08:58.032 / 00:00:00.223 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Verify_Ipv6_Topology_Empty |
---|---|
Documentation: | Verifies that example-ipv6-topology is empty after deconfiguring peer for the first time. |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:08:58.032 / 20241121 04:08:58.334 / 00:00:00.302 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Reconfigure_ODL_To_Accept_Connections_2 |
---|---|
Documentation: | Configure BGP peer modules with initiate-connection set to false with ipv6 address without "::" shortened version. |
Start / End / Elapsed: | 20241121 04:08:58.334 / 20241121 04:08:58.642 / 00:00:00.308 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Verify_Ipv6_Topology_Filled_2 |
---|---|
Documentation: | Verifies that example-ipv6-topology is filled after configuring the peer for the second time. |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:08:58.643 / 20241121 04:09:07.929 / 00:00:09.286 |
Status: | FAIL |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. Needed if the recommended default is to be overriden. |
---|---|
Start / End / Elapsed: | 20241121 04:08:58.643 / 20241121 04:08:58.730 / 00:00:00.087 |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Delete_Bgp_Peer_Configuration_2 |
---|---|
Documentation: | Revert the BGP configuration to the original state: without any configured peers. |
Start / End / Elapsed: | 20241121 04:09:07.929 / 20241121 04:09:08.211 / 00:00:00.282 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Verify_Ipv6_Topology_Empty_2 |
---|---|
Documentation: | Verifies that example-ipv6-topology is empty after deconfiguring peer for the second time. |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:09:08.211 / 20241121 04:09:08.511 / 00:00:00.300 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Reconfigure_ODL_To_Accept_Connections_3 |
---|---|
Documentation: | Configure BGP peer modules with initiate-connection set to false with full text ipv6 address. |
Start / End / Elapsed: | 20241121 04:09:08.511 / 20241121 04:09:08.833 / 00:00:00.322 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Verify_Ipv6_Topology_Filled_3 |
---|---|
Documentation: | Verifies that example-ipv6-topology is filled after configuring the peer for the third time. |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:09:08.833 / 20241121 04:09:18.083 / 00:00:09.250 |
Status: | FAIL |
Message: |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Delete_Bgp_Peer_Configuration_3 |
---|---|
Documentation: | Revert the BGP configuration to the original state: without any configured peers. |
Start / End / Elapsed: | 20241121 04:09:18.083 / 20241121 04:09:18.319 / 00:00:00.236 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Verify_Ipv6_Topology_Empty_3 |
---|---|
Documentation: | Verifies that example-ipv6-topology is empty after final deconfiguration. |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:09:18.320 / 20241121 04:09:18.632 / 00:00:00.312 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Stop_All_Exabgps |
---|---|
Documentation: | Save exabgp logs as exaipv6.log, and stop exabgp with ctrl-c bash signal |
Start / End / Elapsed: | 20241121 04:09:18.632 / 20241121 04:09:18.911 / 00:00:00.279 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Configure_App_Peer |
---|---|
Documentation: | Configures bgp application peer. |
Start / End / Elapsed: | 20241121 04:09:18.911 / 20241121 04:09:19.215 / 00:00:00.304 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Reconfigure_ODL_To_Accept_Connections_4 |
---|---|
Documentation: | Configure BGP peer modules with initiate-connection set to false with short ipv6 address. |
Start / End / Elapsed: | 20241121 04:09:19.215 / 20241121 04:09:19.524 / 00:00:00.309 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Start_Exabgp_2 |
---|---|
Documentation: | Start exabgp and Verify BGP connection |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:09:19.525 / 20241121 04:09:22.671 / 00:00:03.146 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Inject_Ipv6_Route_1 |
---|---|
Documentation: | Inject the Ipv6 route from controller |
Start / End / Elapsed: | 20241121 04:09:22.671 / 20241121 04:09:22.990 / 00:00:00.319 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Check_Ipv6_Prefix_In_Bgp_Rib_1 |
---|---|
Documentation: | Check for the presence of Ipv6 Prefix in the BGP RIB |
Start / End / Elapsed: | 20241121 04:09:22.990 / 20241121 04:09:23.282 / 00:00:00.292 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Delete_Injected_Ipv6_Routes_1 |
---|---|
Documentation: | Delete the injected IPV6 routes |
Start / End / Elapsed: | 20241121 04:09:23.283 / 20241121 04:09:24.215 / 00:00:00.932 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Delete_Bgp_Peer_Configuration_4 |
---|---|
Documentation: | Revert the BGP configuration to the original state: without any configured peers. |
Start / End / Elapsed: | 20241121 04:09:24.215 / 20241121 04:09:24.460 / 00:00:00.245 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Verify_Ipv6_Topology_Empty_4 |
---|---|
Documentation: | Verifies that example-ipv6-topology is empty after deconfiguring peer for the first time. |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:09:24.459 / 20241121 04:09:24.796 / 00:00:00.337 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Reconfigure_ODL_To_Accept_Connections_5 |
---|---|
Documentation: | Configure BGP peer modules with initiate-connection set to false with short ipv6 address. |
Start / End / Elapsed: | 20241121 04:09:24.796 / 20241121 04:09:25.105 / 00:00:00.309 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Inject_Ipv6_Route_2 |
---|---|
Documentation: | Inject the Ipv6 route from controller |
Start / End / Elapsed: | 20241121 04:09:25.105 / 20241121 04:09:25.399 / 00:00:00.294 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Check_Ipv6_Prefix_In_Bgp_Rib_2 |
---|---|
Documentation: | Check for the presence of Ipv6 Prefix in the BGP RIB |
Start / End / Elapsed: | 20241121 04:09:25.399 / 20241121 04:09:25.667 / 00:00:00.268 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Delete_Injected_Ipv6_Routes_2 |
---|---|
Documentation: | Delete the injected IPV6 routes |
Start / End / Elapsed: | 20241121 04:09:25.667 / 20241121 04:09:26.360 / 00:00:00.693 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Delete_App_Peer |
---|---|
Documentation: | Deletes bgp application peer. |
Start / End / Elapsed: | 20241121 04:09:26.360 / 20241121 04:09:26.633 / 00:00:00.273 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Delete_Bgp_Peer_Configuration_5 |
---|---|
Documentation: | Revert the BGP configuration to the original state: without any configured peers. |
Start / End / Elapsed: | 20241121 04:09:26.634 / 20241121 04:09:26.869 / 00:00:00.235 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Verify_Ipv6_Topology_Empty_5 |
---|---|
Documentation: | Verifies that example-ipv6-topology is empty after deconfiguring peer for the first time. |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:09:26.869 / 20241121 04:09:27.189 / 00:00:00.320 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Stop_All_Exabgps_2 |
---|---|
Documentation: | Save exabgp logs as exaipv6.log, and stop exabgp with ctrl-c bash signal |
Start / End / Elapsed: | 20241121 04:09:27.190 / 20241121 04:09:27.451 / 00:00:00.261 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Reconfigure_ODL_To_Accept_Connections_6 |
---|---|
Documentation: | Configure BGP peer modules with initiate-connection set to false with short ipv6 address. |
Start / End / Elapsed: | 20241121 04:09:27.450 / 20241121 04:09:27.758 / 00:00:00.308 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Start_Exabgp_3 |
---|---|
Documentation: | Start exabgp with |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:09:27.759 / 20241121 04:09:46.467 / 00:00:18.708 |
Status: | FAIL |
Message: |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Stop_All_Exabgps_3 |
---|---|
Documentation: | Save exabgp logs as exabgp_graceful_restart.log, and stop exabgp with ctrl-c bash signal |
Start / End / Elapsed: | 20241121 04:09:46.467 / 20241121 04:10:27.407 / 00:00:40.940 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Start_Exabgp_4 |
---|---|
Documentation: | Start exabgp with |
Tags: | critical |
Start / End / Elapsed: | 20241121 04:10:27.408 / 20241121 04:10:46.089 / 00:00:18.681 |
Status: | FAIL |
Message: |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Delete_Bgp_Peer_Configuration_6 |
---|---|
Documentation: | Revert the BGP configuration to the original state: without any configured peers. |
Start / End / Elapsed: | 20241121 04:10:46.089 / 20241121 04:10:46.318 / 00:00:00.229 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Ipv6 Basic.Stop_All_Exabgps_4 |
---|---|
Documentation: | Save exabgp logs as exabgp_graceful_restart.log, and stop exabgp with ctrl-c bash signal |
Start / End / Elapsed: | 20241121 04:10:46.318 / 20241121 04:10:46.548 / 00:00:00.230 |
Status: | PASS |
Full Name: | bgpcep-userfeatures.txt.Bgp Llgr Basic |
---|---|
Documentation: | Functional test for ipv6 connection with bgp. Copyright (c) 2020 Lumina Networks Intellectual Property. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests simple connection between one ibgp peer (goabgp) and Odl. Peer is configured with ipv6, and gobgp connectes to odl via ipv6. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/bgp_llgr_basic.robot |
Start / End / Elapsed: | 20241121 04:10:46.609 / 20241121 04:11:22.697 / 00:00:36.088 |
Status: | 4 tests total, 4 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Bgp App Peer Basic |
---|---|
Documentation: | Basic tests for BGP application peer. Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Test suite performs basic BGP functional test cases for BGP application peer operations and checks for IP4 topology updates and updates towards BGP peer as follows: Test case 1: Initial BGP peer connection with pre-filled topology, POST and simple DELETE requests used. BGP_Application_Peer_Post_3_Initial_Routes, Check_Example-IPv4-Topology_Is_Filled_With_3_Routes, Connect_BGP_Peer, BGP_Peer_Check_Incomming_Updates_For_3_Introduced_Prefixes, BGP_Application_Peer_Delete_3_Initial_Routes, Check_Example-IPv4-Topology_Is_Empty, Peer_Check_Incomming_Updates_For_3_Withdrawn_Prefixes, Stop_BGP_Peer. Test case 2: PUT and DELETE all routes requests while BGP peer is connected. Reconnect_BGP_Peer, BGP_Application_Peer_Put_3_Routes, Check_Example-IPv4-Topology_Is_Filled_With_3_Routes, BGP_Peer_Check_Incomming_Updates_For_3_Introduced_Prefixes, BGP_Application_Peer_Delete_All_Routes, Check_Example-IPv4-Topology_Is_Empty, BGP_Peer_Check_Incomming_Updates_For_3_Withdrawn_Prefixes, Stop_BGP_Peer. Test case 3: Repeated BGP peer re-connection with pre-filled topology. BGP_Application_Peer_Put_3_Routes, Check_Example-IPv4-Topology_Is_Filled_With_3_Routes, Reconnect_BGP_Peer_And_Check_Incomming_Updates_For_3_Introduced_Prefixes, BGP_Application_Peer_Delete_All_Routes, Check_Example-IPv4-Topology_Is_Empty, BGP_Peer_Check_Incomming_Updates_For_3_Withdrawn_Prefixes, Stop_BGP_Peer. Brief description how to configure BGP application peer and how to use restconf application peer interface: https://wiki.opendaylight.org/view/BGP_LS_PCEP:User_Guide#BGP_Application_Peer https://wiki.opendaylight.org/view/BGP_LS_PCEP:Programmer_Guide#BGP |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpuser/bgp_app_peer_basic.robot |
Start / End / Elapsed: | 20241121 04:11:22.697 / 20241121 04:12:08.336 / 00:00:45.639 |
Status: | 28 tests total, 28 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Ibgp Peers Basic |
---|---|
Documentation: | Basic tests for iBGP peers. Copyright (c) 2015-2018 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Test suite performs basic iBGP functional test cases for BGP peers in different roles (iBGP, iBGP RR-client): Test Case 1: Two iBGP RR-client peers introduce prefixes Expected result: controller forwards updates towards both peers Test Case 2: Two iBGP peers: one RR client and one non-client introduces prefixes Expected result: controller forwards updates towards both peers Test Case 3: Two iBGP RR non-client peers introduce prefixes Expected result: controller does not forward any update towards peers Test Case 4: Two iBGP(play.py) RR-client peers configured, first of them configured with route-reflector-cluster-id, second inherits it's cluster-id from global config. Each of them introduces 3 prefixes. Expected result: controller forwards updates towards both peers and each of their adj-rib-in contains routes. First peer should contain default cluster-id and second cluster-id from first peers configuration. For polices see: https://wiki.opendaylight.org/view/BGP_LS_PCEP:BGP |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpuser/ibgp_peers_basic.robot |
Start / End / Elapsed: | 20241121 04:12:08.338 / 20241121 04:13:20.221 / 00:01:11.883 |
Status: | 36 tests total, 36 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Ebgp Peers Basic |
---|---|
Documentation: | Basic tests for eBGP application peers. Copyright (c) 2015-2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Test suite performs basic eBGP functional tests: Two eBGP peers advertise the same group of prefixes (aka BGP HA) https://wiki.opendaylight.org/view/BGP_LS_PCEP:BGP Reported bugs: Bug 4834 - ODL controller announces the same route twice (two eBGP scenario aka HA) Bug 4835 - Routes not withdrawn when eBGP peers are disconnected (the same prefixes announced) For versions Fluorine and above, there are test cases: TC_LAS (test case local AS)
TODO: Extend testsuite by tests dedicated to path selection algorithm TODO: Choose keywords used by more than one test suite to be placed in a common place. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpuser/ebgp_peers_basic.robot |
Start / End / Elapsed: | 20241121 04:13:20.223 / 20241121 04:15:51.137 / 00:02:30.914 |
Status: | 22 tests total, 15 passed, 7 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.010 Bgp Flowspec |
---|---|
Documentation: | Functional test for bgp flowspec. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpflowspec/010_bgp_flowspec.robot |
Start / End / Elapsed: | 20241121 04:15:51.138 / 20241121 04:16:04.636 / 00:00:13.498 |
Status: | 5 tests total, 5 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Ibgp Peer Lsp |
---|---|
Documentation: | Basic tests for iBGP peers. Copyright (c) 2015-2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Test suite performs basic iBGP functional test case for carrying LSP State Information in BGP as described in http://tools.ietf.org/html/draft-ietf-idr-te-lsp-distribution-03 |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpuser/ibgp_peer_lsp.robot |
Start / End / Elapsed: | 20241121 04:16:04.637 / 20241121 04:16:43.558 / 00:00:38.921 |
Status: | 12 tests total, 12 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.010 Bgp Functional L3Vpn |
---|---|
Documentation: | Functional test suite for bgp - l3vpn-ipv4 Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests advertising and receiveing routes with l3vpn content. It uses odl and exabgp as bgp peers. Routes advertized from odl are configured via application peer. Routes advertised from exabgp is statically configured in exabgp config file. For fluorine and further, instead of exabgp, play.py is used. When sending routes from odl to peer, first route containg route-target argument have to be send from peer to odl, so odl can identify this peer. Than it sends l3vpn route containg this argument to odl app peer, and we check that app peer advertizes this route back to the peer. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/010_bgp_functional_l3vpn.robot |
Start / End / Elapsed: | 20241121 04:16:43.559 / 20241121 04:17:02.876 / 00:00:19.317 |
Status: | 9 tests total, 9 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.030 Bgp Functional Evpn |
---|---|
Documentation: | Functional test for bgp - evpn Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests advertising and receiveing routes with evpn content. It uses play.py and odl as bgp peers. Routes advertized from odl are configured via application peer. Routes advertised from play.py are stored in *.hex files. These files are used also as expected data which is recevied from odl. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/030_bgp_functional_evpn.robot |
Start / End / Elapsed: | 20241121 04:17:02.877 / 20241121 04:19:57.970 / 00:02:55.093 |
Status: | 78 tests total, 78 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.040 Bgp Functional Route Ref |
---|---|
Documentation: | Functional test for bgp - route refresh Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests sending and receiveing route refresh message. It uses odl and exabgp as bgp peers. Sending route refresh message from odl is initiated via restconf. If route refresh is received by odl, correct advertising of routes is verified. Receiving of route refresh by odl is verified by checking appropriate message counter via odl-bgpcep-bgp-cli and restconf using BGP neighbor operational state |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/040_bgp_functional_route_ref.robot |
Start / End / Elapsed: | 20241121 04:19:57.971 / 20241121 04:20:44.239 / 00:00:46.268 |
Status: | 6 tests total, 4 passed, 2 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.020 Bgp Functional Multipath |
---|---|
Documentation: | Functional test suite for bgp - n-path and all-path selection Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests n-path and all-path selection policy. It uses odl and exabgp as bgp peers. Routes advertized from odl are configured via application peer. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/020_bgp_functional_multipath.robot |
Start / End / Elapsed: | 20241121 04:20:44.240 / 20241121 04:21:35.099 / 00:00:50.859 |
Status: | 4 tests total, 2 passed, 2 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.060 Bgp Functional Mvpn |
---|---|
Documentation: | Functional test for bgp - mvpn Copyright (c) 2018 AT&T Intellectual Property. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distbmution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests advertising mvpn routes to odl. For advertising play.py is used, and particular files are stored as *.hex files. There are 7 different types of routes used for auto-discovery of multicast network. Also 4 more routes with new attributes specific for mvpn. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/060_bgp_functional_mvpn.robot |
Start / End / Elapsed: | 20241121 04:21:35.100 / 20241121 04:22:54.723 / 00:01:19.623 |
Status: | 29 tests total, 29 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.070 Bgp Functional L3Vpn Mcast |
---|---|
Documentation: | Functional test for bgp - l3vpn-mutlicast Copyright (c) 2018 AT&T Intellectual Property. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distbmution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests advertising l3vpn_mcast routes to odl. For advertising play.py is used, and particular files are stored as *.hex files. There are L3vpn-ipv4-multicast routes and L3vpn-ipv6-multicast routes tested. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/070_bgp_functional_l3vpn_mcast.robot |
Start / End / Elapsed: | 20241121 04:22:54.723 / 20241121 04:23:15.647 / 00:00:20.924 |
Status: | 10 tests total, 10 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.080 Bgp Functional Rt Constrain |
---|---|
Documentation: | Functional test for bgp - route-target-constrain safi Copyright (c) 2018 AT&T Intellectual Property. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distbmution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests advertising rt-constrain routes to odl. For advertising from peer, play.py is used, sending hex messages to odl. For advertising to app-peer, we are sending post requests with routes in xml. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/080_bgp_functional_rt_constrain.robot |
Start / End / Elapsed: | 20241121 04:23:15.648 / 20241121 04:23:47.985 / 00:00:32.337 |
Status: | 14 tests total, 14 passed, 0 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.090 Bgp Functional Rt Constrain Validation |
---|---|
Documentation: | Functional test for bgp - route-target-constrain safi Copyright (c) 2018 AT&T Intellectual Property. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distbmution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite tests advertising rt-constrain routes to odl. For advertising from peer, play.py is used, sending hex messages to odl. There are 3 peers: ebgp and two ibgps. First peer sends l3vpn route with specific RT to odl, second peer sends RT route and third peer only establishes connection. Then it is checked that odl advertizes l3vpn route to second peer. Third peer sends wildcard RT route and it is checked that odl doesn't advertize l3vpn route to it. Then second peer removes RT and it is checked that second peer withdrew RT route and that odl withdrew l3vpn route from it. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/090_bgp_functional_rt_constrain_validation.robot |
Start / End / Elapsed: | 20241121 04:23:47.986 / 20241121 04:24:05.323 / 00:00:17.337 |
Status: | 11 tests total, 8 passed, 3 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Bgp Policies Default |
---|---|
Documentation: | Functional test for bgp routing policies Copyright (c) 2018 AT&T Intellectual Property. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html This suite uses 7 peers: app peer, 2x rr-client, 2x ebgp, 2x ibgp Tests results on effective-rib-in dependant on their respective configurations. Peers 1,2,4,5 are testing multiple ipv4 routes with additional arguments. Peers 3,6 have ipv4 and ipv6 mpls-labeled routes. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/bgpfunct/bgp_policies_default.robot |
Start / End / Elapsed: | 20241121 04:24:05.323 / 20241121 04:24:26.710 / 00:00:21.387 |
Status: | 8 tests total, 7 passed, 1 failed, 0 skipped |
Full Name: | bgpcep-userfeatures.txt.Tcpmd5User |
---|---|
Documentation: | TCPMD5 user-facing feature system tests, using PCEP. Copyright (c) 2015 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Test suite performs basic pcep md5 password authorization test cases: (Run entire basic PCEP suite without passwords.) Start pcc-mock (reconnecting mode): 1 pcc, 1 lsp, password set, check pcep-topology stays empty. Use restconf to change PCEP configuration to use a wrong password, check pcep-topology stays empty. Change ODL PCEP configuration to use the correct password, check pcep-topology shows the lsp. Stop pcc-mock, check pcep-topology stays empty. Start pcc-mock with new password, check pcep-topology stays empty. Change ODL PCEP configuration to use the correct password, check pcep-topology shows the lsp. Update the lsp, check a change in pcep-topology. Change ODL PCEP configuration to not use password, pcep-topology empties, kill pcep-pcc-mock. Test cases no longer need netconf-connector-ssh, and they include comparison of pcep-session-state. |
Source: | /w/workspace/bgpcep-csit-1node-userfeatures-all-calcium/test/csit/suites/bgpcep/tcpmd5user/tcpmd5user.robot |
Start / End / Elapsed: | 20241121 04:24:26.711 / 20241121 04:26:14.410 / 00:01:47.699 |
Status: | 20 tests total, 13 passed, 7 failed, 0 skipped |