Total Statistics | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
All Tests | 140 | 89 | 51 | 0 | 00:34:52 |
Statistics by Tag | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
critical | 40 | 30 | 10 | 0 | 00:17:05 | |
| 8 | 0 | 8 | 0 | 00:02:03 | |
| 6 | 0 | 6 | 0 | 00:05:25 | |
| 4 | 0 | 4 | 0 | 00:02:52 | |
| 4 | 0 | 4 | 0 | 00:04:04 |
Statistics by Suite | Total | Pass | Fail | Skip | Elapsed | Pass / Fail / Skip |
---|---|---|---|---|---|---|
140 | 89 | 51 | 0 | 00:35:35 | ||
26 | 26 | 0 | 0 | 00:00:30 | ||
26 | 15 | 11 | 0 | 00:03:07 | ||
3 | 2 | 1 | 0 | 00:03:08 | ||
17 | 8 | 9 | 0 | 00:06:24 | ||
3 | 2 | 1 | 0 | 00:03:09 | ||
22 | 16 | 6 | 0 | 00:07:53 | ||
17 | 5 | 12 | 0 | 00:08:21 | ||
26 | 15 | 11 | 0 | 00:03:03 |
Full Name: | netconf-clustering.txt |
---|---|
Start / End / Elapsed: | 20250316 23:48:37.681 / 20250317 00:24:12.509 / 00:35:34.828 |
Status: | 140 tests total, 89 passed, 51 failed, 0 skipped |
Full Name: | netconf-clustering.txt.CRUD |
---|---|
Documentation: | netconf clustered CRUD test suite. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the node1, node2 and node3 to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/CRUD.robot |
Start / End / Elapsed: | 20250316 23:48:37.705 / 20250316 23:49:07.627 / 00:00:29.922 |
Status: | 26 tests total, 26 passed, 0 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Bug8086 |
---|---|
Documentation: | Simplified netconf clustered CRUD test suite in Bug 8086 setup. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the node1, node2 and node3 to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/bug8086.robot |
Start / End / Elapsed: | 20250316 23:49:07.628 / 20250316 23:52:14.254 / 00:03:06.626 |
Status: | 26 tests total, 15 passed, 11 failed, 0 skipped |
Documentation: | Initialize resources, sreate sessions, on each ODL machine create a directory and copy the car model there. |
---|---|
Start / End / Elapsed: | 20250316 23:49:07.711 / 20250316 23:49:14.197 / 00:00:06.486 |
Documentation: | Teardown the test infrastructure, perform cleanup and release all resources. |
---|---|
Start / End / Elapsed: | 20250316 23:52:13.847 / 20250316 23:52:14.254 / 00:00:00.407 |
Full Name: | netconf-clustering.txt.Bug8086.Start_Testtool |
---|---|
Documentation: | Deploy and start test tool, then wait for all its devices to become online. |
Start / End / Elapsed: | 20250316 23:49:14.197 / 20250316 23:49:19.842 / 00:00:05.645 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Is_Not_Mounted_At_Beginning |
---|---|
Documentation: | Sanity check making sure our device is not there. Fail if found. |
Tags: | critical |
Start / End / Elapsed: | 20250316 23:49:19.842 / 20250316 23:49:20.149 / 00:00:00.307 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Configure_Device_On_Netconf |
---|---|
Documentation: | Make request to configure a testtool device on Netconf connector |
Tags: | critical |
Start / End / Elapsed: | 20250316 23:49:20.149 / 20250316 23:49:20.597 / 00:00:00.448 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Check_Configurer_Has_Netconf_Connector_For_Device |
---|---|
Documentation: | Get the list of mounts and search for our device there. Fail if not found. |
Tags: | critical |
Start / End / Elapsed: | 20250316 23:49:20.598 / 20250316 23:49:20.921 / 00:00:00.323 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Wait_For_Device_To_Become_Visible_For_Configurer |
---|---|
Documentation: | Wait until the device becomes visible on configurer node. |
Start / End / Elapsed: | 20250316 23:49:20.921 / 20250316 23:49:23.324 / 00:00:02.403 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Wait_For_Device_To_Become_Visible_For_Checker |
---|---|
Documentation: | Wait until the device becomes visible on checker node. |
Start / End / Elapsed: | 20250316 23:49:23.325 / 20250316 23:49:23.601 / 00:00:00.276 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Wait_For_Device_To_Become_Visible_For_Setter |
---|---|
Documentation: | Wait until the device becomes visible on setter node. |
Start / End / Elapsed: | 20250316 23:49:23.601 / 20250316 23:49:23.896 / 00:00:00.295 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Data_Is_Seen_As_Empty_On_Configurer |
---|---|
Documentation: | Get the device data as seen by configurer and make sure it is empty. |
Start / End / Elapsed: | 20250316 23:49:23.897 / 20250316 23:49:24.214 / 00:00:00.317 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Data_Is_Seen_As_Empty_On_Checker |
---|---|
Documentation: | Get the device data as seen by checker and make sure it is empty. |
Start / End / Elapsed: | 20250316 23:49:24.214 / 20250316 23:49:24.519 / 00:00:00.305 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Data_Is_Seen_As_Empty_On_Setter |
---|---|
Documentation: | Get the device data as seen by setter and make sure it is empty. |
Start / End / Elapsed: | 20250316 23:49:24.519 / 20250316 23:49:35.211 / 00:00:10.692 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Create_Device_Data |
---|---|
Documentation: | Send some sample test data into the device and check that the request went OK. |
Start / End / Elapsed: | 20250316 23:49:35.212 / 20250316 23:49:35.586 / 00:00:00.374 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Check_New_Device_Data_Is_Visible_On_Setter |
---|---|
Documentation: | Get the device data and make sure it contains the created content. |
Start / End / Elapsed: | 20250316 23:49:35.586 / 20250316 23:49:46.256 / 00:00:10.670 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Check_New_Device_Data_Is_Visible_On_Checker |
---|---|
Documentation: | Check that the created device data make their way into the checker node. |
Start / End / Elapsed: | 20250316 23:49:46.257 / 20250316 23:49:57.319 / 00:00:11.062 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Check_New_Device_Data_Is_Visible_On_Configurer |
---|---|
Documentation: | Check that the created device data make their way into the configurer node. |
Start / End / Elapsed: | 20250316 23:49:57.319 / 20250316 23:50:08.327 / 00:00:11.008 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Modify_Device_Data |
---|---|
Documentation: | Send a request to change the sample test data and check that the request went OK. |
Start / End / Elapsed: | 20250316 23:50:08.327 / 20250316 23:50:08.705 / 00:00:00.378 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Data_Is_Modified |
---|---|
Documentation: | Get the device data and make sure it contains the modified content. |
Start / End / Elapsed: | 20250316 23:50:08.705 / 20250316 23:50:08.931 / 00:00:00.226 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Check_Modified_Device_Data_Is_Visible_On_Checker |
---|---|
Documentation: | Check that the modified device data make their way into the checker node. |
Start / End / Elapsed: | 20250316 23:50:08.931 / 20250316 23:51:09.167 / 00:01:00.236 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Check_Modified_Device_Data_Is_Visible_On_Configurer |
---|---|
Documentation: | Check that the modified device data make their way into the configurer node. |
Start / End / Elapsed: | 20250316 23:51:09.167 / 20250316 23:52:10.386 / 00:01:01.219 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Delete_Device_Data |
---|---|
Documentation: | Send a request to delete the sample test data on the device and check that the request went OK. |
Start / End / Elapsed: | 20250316 23:52:10.387 / 20250316 23:52:10.689 / 00:00:00.302 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Data_Is_Deleted |
---|---|
Documentation: | Get the device data and make sure it is empty again. |
Start / End / Elapsed: | 20250316 23:52:10.689 / 20250316 23:52:10.938 / 00:00:00.249 |
Status: | FAIL |
Message: |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Data_Deletion_Is_Visible_On_Checker |
---|---|
Documentation: | Check that the device data deletion makes its way into the checker node. |
Start / End / Elapsed: | 20250316 23:52:10.938 / 20250316 23:52:11.246 / 00:00:00.308 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Data_Deletion_Is_Visible_On_Configurer |
---|---|
Documentation: | Check that the device data deletion makes its way into the checker node. |
Start / End / Elapsed: | 20250316 23:52:11.246 / 20250316 23:52:11.528 / 00:00:00.282 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Deconfigure_Device_In_Netconf |
---|---|
Documentation: | Make request to deconfigure the device on Netconf connector. |
Tags: | critical |
Start / End / Elapsed: | 20250316 23:52:11.529 / 20250316 23:52:11.875 / 00:00:00.346 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Deconfigured_On_Configurer |
---|---|
Documentation: | Check that the device is really going to be gone. Fail if still there after one minute. This is an expected behavior as the unmount request is sent to the config subsystem which then triggers asynchronous disconnection of the device which is reflected in the operational data once completed. This test makes sure this asynchronous operation does not take unreasonable amount of time. |
Tags: | critical |
Start / End / Elapsed: | 20250316 23:52:11.875 / 20250316 23:52:12.176 / 00:00:00.301 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Deconfigured_On_Checker |
---|---|
Documentation: | Check that the device is going to be gone from the checker node. Fail if still there after one minute. |
Tags: | critical |
Start / End / Elapsed: | 20250316 23:52:12.176 / 20250316 23:52:13.540 / 00:00:01.364 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Bug8086.Check_Device_Deconfigured_On_Setter |
---|---|
Documentation: | Check that the device is going to be gone from the setter node. Fail if still there after one minute. |
Tags: | critical |
Start / End / Elapsed: | 20250316 23:52:13.540 / 20250316 23:52:13.845 / 00:00:00.305 |
Status: | PASS |
Full Name: | netconf-clustering.txt.Restart Odl With Tell Based False |
---|---|
Documentation: | Unset tell-based protocol usage Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot |
Start / End / Elapsed: | 20250316 23:52:14.256 / 20250316 23:55:22.515 / 00:03:08.259 |
Status: | 3 tests total, 2 passed, 1 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Entity |
---|---|
Documentation: | Test suite for netconf device entity ownership handling during outages. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the ${NODE_CONFIGURER}, ${NODE_SETTER} and ${NODE_CHECKER} to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/entity.robot |
Start / End / Elapsed: | 20250316 23:55:22.516 / 20250317 00:01:46.065 / 00:06:23.549 |
Status: | 17 tests total, 8 passed, 9 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Restart Odl With Tell Based False |
---|---|
Documentation: | Unset tell-based protocol usage Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot |
Start / End / Elapsed: | 20250317 00:01:46.067 / 20250317 00:04:54.920 / 00:03:08.853 |
Status: | 3 tests total, 2 passed, 1 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Outages |
---|---|
Documentation: | netconf cluster node outage test suite (CRUD operations). Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform one of the basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector while one of the nodes is down and see if they work. Then bring the dead node up and check that it sees the operations that were made while it was down are visible on it as well. The node is brought down before each of the "Create", "Update" and "Delete" operations and brought and back up after these operations. Before the dead node is brought up, a test case makes sure the operation is properly propagated within the cluster. Currently each of the 3 operations is done once. "Create" is done while node 1 is down, "Update" while node 2 is down and "Delete" while node 3 is down. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/outages.robot |
Start / End / Elapsed: | 20250317 00:04:54.920 / 20250317 00:12:47.897 / 00:07:52.977 |
Status: | 22 tests total, 16 passed, 6 failed, 0 skipped |
Full Name: | netconf-clustering.txt.Entity |
---|---|
Documentation: | Test suite for netconf device entity ownership handling during outages. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the ${NODE_CONFIGURER}, ${NODE_SETTER} and ${NODE_CHECKER} to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/entity.robot |
Start / End / Elapsed: | 20250317 00:12:47.898 / 20250317 00:21:09.384 / 00:08:21.486 |
Status: | 17 tests total, 5 passed, 12 failed, 0 skipped |
Full Name: | netconf-clustering.txt.CRUD |
---|---|
Documentation: | netconf clustered CRUD test suite. Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved. This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html Perform basic operations (Create, Read, Update and Delete or CRUD) on device data mounted onto a netconf connector and see if they work. The suite recognizes 3 nodes, "CONFIGURER" (the node that configures the device at the beginning and then deconfigures it at the end), "SETTER" (the node that manipulates the data on the device) and "CHECKER" (the node that checks the data on the device). The configured device and the results of each data operation on it is expected to be visible on all nodes so after each operation three test cases make sure they can see the result on their respective nodes. The 3 nodes are configured by placing "node1", "node2" or "node3" into the node1, node2 and node3 to make the node a "CONFIGURER", "SETTER" and "CHECKER" respectively. The "nodeX" name refers to the node with its IP address configured with the ${ODL_SYSTEM_X_IP} variable where the "X" is 1, 2 or 3. The suite checks the integrity of the presence of the device and the data seen on the device only for nodes that have at least one of the roles ("CONFIGURER", "SETTER" and "CHECKER") assigned. A better design would have a "checker list" of sorts and have only one checking test case that runs through the check list and performs the test on each node listed. However this currently has fairly low priority due to Beryllium delivery date so it was left out. |
Source: | /w/workspace/netconf-csit-3node-clustering-only-scandium/test/csit/suites/netconf/clustering/CRUD.robot |
Start / End / Elapsed: | 20250317 00:21:09.385 / 20250317 00:24:12.508 / 00:03:03.123 |
Status: | 26 tests total, 15 passed, 11 failed, 0 skipped |