Total Statistics | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
All Tests | 140 | 100 | 40 | 0 | 00:32:06 |
Statistics by Tag | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
critical | 40 | 30 | 10 | 0 | 00:17:02 | |
| 8 | 0 | 8 | 0 | 00:02:03 | |
| 6 | 0 | 6 | 0 | 00:05:26 | |
| 4 | 0 | 4 | 0 | 00:02:53 | |
| 4 | 0 | 4 | 0 | 00:04:04 |
Statistics by Suite | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
140 | 100 | 40 | 0 | 00:32:48 | ||
26 | 26 | 0 | 0 | 00:00:29 | ||
26 | 26 | 0 | 0 | 00:00:22 | ||
3 | 2 | 1 | 0 | 00:03:08 | ||
17 | 8 | 9 | 0 | 00:06:23 | ||
3 | 2 | 1 | 0 | 00:03:11 | ||
22 | 16 | 6 | 0 | 00:07:52 | ||
17 | 5 | 12 | 0 | 00:08:21 | ||
26 | 15 | 11 | 0 | 00:03:03 |
Full Name: | netconf-clustering.txt |
---|---|
Start / End / Elapsed: | 20250223 23:48:45.578 / 20250224 00:21:33.575 / 00:32:47.997 |
Status: | 140 tests total, 100 passed, 40 failed, 0 skipped |
Full Name: | netconf-clustering.txt.CRUD |
---|---|
Documentation: | netconf clustered CRUD test suite. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the node1, node2 and node3 to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/CRUD.robot |
Start / End / Elapsed: | 20250223 23:48:45.602 / 20250223 23:49:14.106 / 00:00:28.504 |
Status: | 26 tests total, 26 passed, 0 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Bug8086 |
---|---|
Documentation: | Simplified netconf clustered CRUD test suite in Bug 8086 setup. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the node1, node2 and node3 to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/bug8086.robot |
Start / End / Elapsed: | 20250223 23:49:14.108 / 20250223 23:49:35.935 / 00:00:21.827 |
Status: | 26 tests total, 26 passed, 0 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Restart Odl With Tell Based False |
---|---|
Documentation: | Unset tell-based protocol usage Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot |
Start / End / Elapsed: | 20250223 23:49:35.936 / 20250223 23:52:43.551 / 00:03:07.615 |
Status: | 3 tests total, 2 passed, 1 failed, 0 skipped |
Documentation: | Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly. |
---|---|
Start / End / Elapsed: | 20250223 23:49:36.097 / 20250223 23:49:38.235 / 00:00:02.138 |
Documentation: | Closes all open connections. |
---|---|
Start / End / Elapsed: | 20250223 23:52:43.551 / 20250223 23:52:43.551 / 00:00:00.000 |
Full Name: | netconf-clustering.txt.Restart Odl With Tell Based False.Stop_All_Members |
---|---|
Documentation: | Stop every odl node. |
Tags: | critical |
Start / End / Elapsed: | 20250223 23:49:38.234 / 20250223 23:51:45.551 / 00:02:07.317 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Restart Odl With Tell Based False.Unset_Tell_Based_Protocol_Usage |
---|---|
Documentation: | Comment out the flag usage in config file. Also clean most data except data/log/. |
Tags: | critical |
Start / End / Elapsed: | 20250223 23:51:45.552 / 20250223 23:51:55.789 / 00:00:10.237 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Entity |
---|---|
Documentation: | Test suite for netconf device entity ownership handling during outages. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the ${NODE_CONFIGURER}, ${NODE_SETTER} and ${NODE_CHECKER} to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/entity.robot |
Start / End / Elapsed: | 20250223 23:52:43.552 / 20250223 23:59:06.973 / 00:06:23.421 |
Status: | 17 tests total, 8 passed, 9 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Restart Odl With Tell Based False |
---|---|
Documentation: | Unset tell-based protocol usage Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot |
Start / End / Elapsed: | 20250223 23:59:06.974 / 20250224 00:02:17.518 / 00:03:10.544 |
Status: | 3 tests total, 2 passed, 1 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Outages |
---|---|
Documentation: | netconf cluster node outage test suite (CRUD operations). Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform one of the basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector while one of the nodes is down and see if they work. Then bring the dead node up and check that it sees the operations that were made while it was down are visible on it as well. The node is brought down before each of the "Create", "Update" and "Delete" operations and brought and back up after these operations. Before the dead node is brought up, a test case makes sure the operation is properly propagated within the cluster. Currently each of the 3 operations is done once. "Create" is done while node 1 is down, "Update" while node 2 is down and "Delete" while node 3 is down. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/outages.robot |
Start / End / Elapsed: | 20250224 00:02:17.518 / 20250224 00:10:09.536 / 00:07:52.018 |
Status: | 22 tests total, 16 passed, 6 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Entity |
---|---|
Documentation: | Test suite for netconf device entity ownership handling during outages. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the ${NODE_CONFIGURER}, ${NODE_SETTER} and ${NODE_CHECKER} to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/entity.robot |
Start / End / Elapsed: | 20250224 00:10:09.537 / 20250224 00:18:30.102 / 00:08:20.565 |
Status: | 17 tests total, 5 passed, 12 failed, 0 skipped |
Full Name: | netconf-clustering.txt.CRUD |
---|---|
Documentation: | netconf clustered CRUD test suite. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the node1, node2 and node3 to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/CRUD.robot |
Start / End / Elapsed: | 20250224 00:18:30.104 / 20250224 00:21:33.575 / 00:03:03.471 |
Status: | 26 tests total, 15 passed, 11 failed, 0 skipped |