Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
19523172002:14:48
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
carpeople
85085000:00:00
clustering
85085000:00:00
critical
19523172002:14:48
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
controller-clustering-ask.txt
19523172002:17:07
controller-clustering-ask . txt . Restart Odl With Tell Based False
321000:05:30
controller-clustering-ask . txt . Rpc Provider Precedence
880000:00:11
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:33
controller-clustering-ask . txt . Rpc Provider Partition And Heal
716000:03:03
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:22
controller-clustering-ask . txt . Action Provider Precedence
817000:00:09
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:25
controller-clustering-ask . txt . Action Provider Partition And Heal
707000:01:44
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:21
controller-clustering-ask . txt . Master Stability
606000:00:08
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:25
controller-clustering-ask . txt . Partition And Heal
606000:00:07
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:23
controller-clustering-ask . txt . Chasing The Leader
312000:01:07
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:26
controller-clustering-ask . txt . Global Rpc Kill
11011000:00:08
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:21
controller-clustering-ask . txt . Global Rpc Freeze
10010000:00:06
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:26
controller-clustering-ask . txt . Global Rpc Isolate
11011000:00:08
controller-clustering-ask . txt . Restart Odl With Tell Based False
312000:12:21
controller-clustering-ask . txt . Carpeople Crud
13013000:00:06
controller-clustering-ask . txt . Car Failover Crud
16016000:00:05
controller-clustering-ask . txt . Car Persistence Recovery
707000:00:05
controller-clustering-ask . txt . Buycar Failover
10010000:00:05
controller-clustering-ask . txt . Entity Isolate
505000:00:07
controller-clustering-ask . txt . Buycar Failover Isolation
10010000:00:05
controller-clustering-ask . txt . Car Failover Crud Isolation
16016000:00:05
controller-clustering-ask . txt . Car Outage Corners
808000:00:05

Test Execution Log

02:17:07.467 SUITE controller-clustering-ask.txt
Full Name: controller-clustering-ask.txt
Start / End / Elapsed: 20250308 23:48:18.608 / 20250309 02:05:26.075 / 02:17:07.467
Status: 195 tests total, 23 passed, 172 failed, 0 skipped
00:05:30.198 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250308 23:48:18.630 / 20250308 23:53:48.828 / 00:05:30.198
Status: 3 tests total, 2 passed, 1 failed, 0 skipped
00:00:05.526 SETUP SetupUtils . Setup_Utils_For_Setup_And_Teardown   http_timeout=125
Documentation:

Prepare both FailFast and Karaf logging, log that the caller suite has started. This keyword is to be used in suite setup, and without it the other keywords may not work properly.
Start / End / Elapsed: 20250308 23:48:19.171 / 20250308 23:48:24.697 / 00:00:05.526
00:00:00.000 TEARDOWN SSHLibrary . Close All Connections  
Documentation:

Closes all open connections.
Start / End / Elapsed: 20250308 23:53:48.828 / 20250308 23:53:48.828 / 00:00:00.000
00:04:12.491 TEST Stop_All_Members
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False.Stop_All_Members
Documentation:

Stop every odl node.
Tags: critical
Start / End / Elapsed: 20250308 23:48:24.697 / 20250308 23:52:37.188 / 00:04:12.491
Status: PASS
00:00:09.981 TEST Unset_Tell_Based_Protocol_Usage
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False.Unset_Tell_Based_Protocol_Usage
Documentation:

Comment out the flag usage in config file. Also clean most data except data/log/.
Tags: critical
Start / End / Elapsed: 20250308 23:52:37.188 / 20250308 23:52:47.169 / 00:00:09.981
Status: PASS
00:01:01.658 TEST Start_All_And_Sync
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False.Start_All_And_Sync
Documentation:

Start each member and wait for sync.
Tags: critical
Start / End / Elapsed: 20250308 23:52:47.169 / 20250308 23:53:48.827 / 00:01:01.658
Status: FAIL
Message: Got rc: 1 or stderr was not empty: sudo: netstat: command not found
00:00:59.890 KEYWORD ClusterManagement . Start_Members_From_List_Or_All  
Documentation:

If the list is empty, start all cluster members. Otherwise, start members based on present indices. If ${wait_for_sync}, wait for cluster sync on listed members. Optionally karaf_home can be overriden. Optionally specific JAVA_HOME is used for starting. Garbage collection is unconditionally logged to files. TODO: Make that reasonable conditional?
Start / End / Elapsed: 20250308 23:52:47.174 / 20250308 23:53:47.064 / 00:00:59.890
00:00:01.322 KEYWORD BuiltIn . Wait Until Keyword Succeeds   60s 10s ClusterManagement.Run_Bash_Command_On_List_Or_All netstat -punta
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 23:53:47.064 / 20250308 23:53:48.386 / 00:00:01.322
00:00:00.003 KEYWORD ${index_list} = ClusterManagement . List_Indices_Or_All  
Documentation:

Utility to allow ${EMPTY} as default argument value, as the internal list is computed at runtime. This keyword always returns a (shallow) copy of given or default list, so operations with the returned list should not affect other lists. Also note that this keyword does not consider empty list to be ${EMPTY}.
Start / End / Elapsed: 20250308 23:53:48.386 / 20250308 23:53:48.389 / 00:00:00.003
00:00:00.438 FOR ${index} IN @{index_list}  
Start / End / Elapsed: 20250308 23:53:48.389 / 20250308 23:53:48.827 / 00:00:00.438
00:00:00.000 KEYWORD BuiltIn . Wait Until Keyword Succeeds   60s 10s ShardStability.Shards_Stability_Get_Details ${DEFAULT_SHARD_LIST} verify_restconf=True
Documentation:

Runs the specified keyword and retries if it fails.
Start / End / Elapsed: 20250308 23:53:48.827 / 20250308 23:53:48.827 / 00:00:00.000
00:00:10.972 SUITE Rpc Provider Precedence
Full Name: controller-clustering-ask.txt.Rpc Provider Precedence
Documentation:

DOMRpcBroker testing: RPC Provider Precedence

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

The aim is to establish that remote RPC implementations have lower priority than local ones, which is to say that any movement of RPCs on remote nodes does not affect routing as long as a local implementation is available.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_precedence.robot
Start / End / Elapsed: 20250308 23:53:48.829 / 20250308 23:53:59.801 / 00:00:10.972
Status: 8 tests total, 8 passed, 0 failed, 0 skipped
00:12:32.536 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250308 23:53:59.802 / 20250309 00:06:32.338 / 00:12:32.536
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:03:02.671 SUITE Rpc Provider Partition And Heal
Full Name: controller-clustering-ask.txt.Rpc Provider Partition And Heal
Documentation:

DOMRpcBroker testing: RPC Provider Partition And Heal

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This tests establishes that the RPC service operates correctly when faced with node failures. This suite supports more than three node cluster setup too.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/rpc_provider_partition_and_heal.robot
Start / End / Elapsed: 20250309 00:06:32.338 / 20250309 00:09:35.009 / 00:03:02.671
Status: 7 tests total, 1 passed, 6 failed, 0 skipped
00:12:21.709 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250309 00:09:35.010 / 20250309 00:21:56.719 / 00:12:21.709
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:09.081 SUITE Action Provider Precedence
Full Name: controller-clustering-ask.txt.Action Provider Precedence
Documentation:

DOMRpcBroker testing: Action Provider Precedence

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

The aim is to establish that remote action implementations have lower priority than local ones, which is to say that any movement of actions on remote nodes does not affect routing as long as a local implementation is available.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_precedence.robot
Start / End / Elapsed: 20250309 00:21:56.719 / 20250309 00:22:05.800 / 00:00:09.081
Status: 8 tests total, 1 passed, 7 failed, 0 skipped
00:12:25.100 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250309 00:22:05.801 / 20250309 00:34:30.901 / 00:12:25.100
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:01:44.220 SUITE Action Provider Partition And Heal
Full Name: controller-clustering-ask.txt.Action Provider Partition And Heal
Documentation:

DOMRpcBroker testing: RPC Action Provider Partition And Heal

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This tests establishes that the RPC service for actions operates correctly when faced with node failures. This suite supports more than three node cluster setup too.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_rpc_broker/action_provider_partition_and_heal.robot
Start / End / Elapsed: 20250309 00:34:30.902 / 20250309 00:36:15.122 / 00:01:44.220
Status: 7 tests total, 0 passed, 7 failed, 0 skipped
00:12:21.097 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250309 00:36:15.122 / 20250309 00:48:36.219 / 00:12:21.097
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:07.731 SUITE Master Stability
Full Name: controller-clustering-ask.txt.Master Stability
Documentation:

Cluster Singleton testing: Master Stability

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Cluster Singleton service is designed to ensure that only one instance of an application is registered globally in the cluster. The goal is to establish the service operates correctly in face of application registration changing without moving the active instance.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/master_stability.robot
Start / End / Elapsed: 20250309 00:48:36.220 / 20250309 00:48:43.951 / 00:00:07.731
Status: 6 tests total, 0 passed, 6 failed, 0 skipped
00:12:24.580 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250309 00:48:43.951 / 20250309 01:01:08.531 / 00:12:24.580
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:07.019 SUITE Partition And Heal
Full Name: controller-clustering-ask.txt.Partition And Heal
Documentation:

Cluster Singleton testing: Partition And Heal

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Cluster Singleton service is designed to ensure that only one instance of an application is registered globally in the cluster. The goal is to establish the service operates correctly in face of node failures.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/partition_and_heal.robot
Start / End / Elapsed: 20250309 01:01:08.532 / 20250309 01:01:15.551 / 00:00:07.019
Status: 6 tests total, 0 passed, 6 failed, 0 skipped
00:12:23.381 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250309 01:01:15.551 / 20250309 01:13:38.932 / 00:12:23.381
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:01:07.182 SUITE Chasing The Leader
Full Name: controller-clustering-ask.txt.Chasing The Leader
Documentation:

Cluster Singleton testing: Chasing the Leader

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test aims to establish the service operates correctly when faced with rapid application transitions without having a stabilized application.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/cluster_singleton/chasing_the_leader.robot
Start / End / Elapsed: 20250309 01:13:38.933 / 20250309 01:14:46.115 / 00:01:07.182
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:12:26.296 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250309 01:14:46.115 / 20250309 01:27:12.411 / 00:12:26.296
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:07.739 SUITE Global Rpc Kill
Full Name: controller-clustering-ask.txt.Global Rpc Kill
Documentation:

Controller functional HA testing of global singleton rpcs.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_kill.robot
Start / End / Elapsed: 20250309 01:27:12.412 / 20250309 01:27:20.151 / 00:00:07.739
Status: 11 tests total, 0 passed, 11 failed, 0 skipped
00:12:20.882 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250309 01:27:20.152 / 20250309 01:39:41.034 / 00:12:20.882
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:06.094 SUITE Global Rpc Freeze
Full Name: controller-clustering-ask.txt.Global Rpc Freeze
Documentation:

Controller functional HA testing of global singleton rpcs if jvm frozen.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_freeze.robot
Start / End / Elapsed: 20250309 01:39:41.034 / 20250309 01:39:47.128 / 00:00:06.094
Status: 10 tests total, 0 passed, 10 failed, 0 skipped
Message: Suite setup failed: NoValidConnectionsError: [Errno None] Unable to connect to port 8101 on 10.30.171.20
00:12:26.047 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250309 01:39:47.129 / 20250309 01:52:13.176 / 00:12:26.047
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:07.716 SUITE Global Rpc Isolate
Full Name: controller-clustering-ask.txt.Global Rpc Isolate
Documentation:

Controller functional HA testing of global singleton rpcs.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/singleton_service/global_rpc_isolate.robot
Start / End / Elapsed: 20250309 01:52:13.177 / 20250309 01:52:20.893 / 00:00:07.716
Status: 11 tests total, 0 passed, 11 failed, 0 skipped
00:12:20.792 SUITE Restart Odl With Tell Based False
Full Name: controller-clustering-ask.txt.Restart Odl With Tell Based False
Documentation:

Unset tell-based protocol usage

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Suite stops all odl nodes, outcomment usage of tell-based protocol in config file (means make it false by default) and starts all nodes again.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/dom_data_broker/restart_odl_with_tell_based_false.robot
Start / End / Elapsed: 20250309 01:52:20.893 / 20250309 02:04:41.685 / 00:12:20.792
Status: 3 tests total, 1 passed, 2 failed, 0 skipped
00:00:06.070 SUITE Carpeople Crud
Full Name: controller-clustering-ask.txt.Carpeople Crud
Documentation:

Suite for performing basic car/people CRUD operations on leaders and followers.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

More precisely, Update operation is not executed, but some operations are using specific RPCs which goes beyond "basic CRUD".

Cars are added by one big PUT to datastore on car Leader. People are added in a loop with add-person RPC on a people Follower. Cars are bought by chunks on each member, by loop with buy-car RPC.

All data is deleted at the end of the suite. This suite expects car, people and car-people modules to have separate Shards.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/carpeople_crud.robot
Start / End / Elapsed: 20250309 02:04:41.686 / 20250309 02:04:47.756 / 00:00:06.070
Status: 13 tests total, 0 passed, 13 failed, 0 skipped
Message: Suite setup failed: ConnectionError: HTTPConnectionPool(host='10.30.171.20', port=8181): Max retries exceeded with url: /rests/data/ietf-yang-library:modules-state?content=nonconfig (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fba8a992cd0>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:05.288 SUITE Car Failover Crud
Full Name: controller-clustering-ask.txt.Car Failover Crud
Documentation:

Suite mixing basic operations with restart of car Leader.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test stops the current leader of the "car" shard and then executes CRD operations on the new leader and a new follower. The stopped member is brought back. This suite uses 3 different car sets, same size but different starting ID.

Other models and shards (people, car-people) are not accessed by this suite.

All data is deleted at the end of the suite. This suite expects car module to have a separate Shard.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud.robot
Start / End / Elapsed: 20250309 02:04:47.757 / 20250309 02:04:53.045 / 00:00:05.288
Status: 16 tests total, 0 passed, 16 failed, 0 skipped
Message: Suite setup failed: ConnectionError: HTTPConnectionPool(host='10.30.171.20', port=8181): Max retries exceeded with url: /rests/data/ietf-yang-library:modules-state?content=nonconfig (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fba88b125d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:05.303 SUITE Car Persistence Recovery
Full Name: controller-clustering-ask.txt.Car Persistence Recovery
Documentation:

This test restarts all controllers to verify recovery of car data from persistence.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

Other models and shards (people, car-people) are not accessed by this suite.

All data is deleted at the end of the suite. This suite expects car module to have a separate Shard.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_persistence_recovery.robot
Start / End / Elapsed: 20250309 02:04:53.045 / 20250309 02:04:58.348 / 00:00:05.303
Status: 7 tests total, 0 passed, 7 failed, 0 skipped
Message: Suite setup failed: ConnectionError: HTTPConnectionPool(host='10.30.171.20', port=8181): Max retries exceeded with url: /rests/data/ietf-yang-library:modules-state?content=nonconfig (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fba880d7e10>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:05.364 SUITE Buycar Failover
Full Name: controller-clustering-ask.txt.Buycar Failover
Documentation:

This test focuses on testing buy-car RPC over 3 Leader reboots.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

All purchases are against the same node, which is the first one to get rebooted.

All data is deleted at the end of the suite. This suite expects car, people and car-people modules to have separate Shards.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover.robot
Start / End / Elapsed: 20250309 02:04:58.349 / 20250309 02:05:03.713 / 00:00:05.364
Status: 10 tests total, 0 passed, 10 failed, 0 skipped
Message: Suite setup failed: ConnectionError: HTTPConnectionPool(host='10.30.171.20', port=8181): Max retries exceeded with url: /rests/data/ietf-yang-library:modules-state?content=nonconfig (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fba88b38050>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:06.636 SUITE Entity Isolate
Full Name: controller-clustering-ask.txt.Entity Isolate
Documentation:

Suite for performing member isolation and rejoin, we do with entity-ownership leader.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/entity_isolate.robot
Start / End / Elapsed: 20250309 02:05:03.713 / 20250309 02:05:10.349 / 00:00:06.636
Status: 5 tests total, 0 passed, 5 failed, 0 skipped
Message: Suite setup failed: ConnectionError: HTTPConnectionPool(host='10.30.171.20', port=8181): Max retries exceeded with url: /rests/data/ietf-yang-library:modules-state?content=nonconfig (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fba88f8a950>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:05.317 SUITE Buycar Failover Isolation
Full Name: controller-clustering-ask.txt.Buycar Failover Isolation
Documentation:

This test focuses on testing buy-car RPC over the Leader isolation.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

All purchases are against the same node, which is the first one to get isolated.

All data is deleted at the end of the suite. This suite expects car, people and car-people modules to have separate Shards.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/buycar_failover_isolation.robot
Start / End / Elapsed: 20250309 02:05:10.350 / 20250309 02:05:15.667 / 00:00:05.317
Status: 10 tests total, 0 passed, 10 failed, 0 skipped
Message: Suite setup failed: ConnectionError: HTTPConnectionPool(host='10.30.171.20', port=8181): Max retries exceeded with url: /rests/data/ietf-yang-library:modules-state?content=nonconfig (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fba88292b10>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:05.247 SUITE Car Failover Crud Isolation
Full Name: controller-clustering-ask.txt.Car Failover Crud Isolation
Documentation:

Suite mixing basic operations with isolation of car Leader.

Copyright (c) 2017 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test isolates the current leader of the "car" shard and then executes CRD operations on the new leader and a new follower. The isolated member is brought back. This suite uses 3 different car sets, same size but different starting ID.

Other models and shards (people, car-people) are not accessed by this suite.

All data is deleted at the end of the suite. This suite expects car module to have a separate Shard.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_failover_crud_isolation.robot
Start / End / Elapsed: 20250309 02:05:15.667 / 20250309 02:05:20.914 / 00:00:05.247
Status: 16 tests total, 0 passed, 16 failed, 0 skipped
Message: Suite setup failed: ConnectionError: HTTPConnectionPool(host='10.30.171.20', port=8181): Max retries exceeded with url: /rests/data/ietf-yang-library:modules-state?content=nonconfig (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fba73e08f50>: Failed to establish a new connection: [Errno 111] Connection refused'))
00:00:05.159 SUITE Car Outage Corners
Full Name: controller-clustering-ask.txt.Car Outage Corners
Documentation:

Cluster suite for testing minimal and sum-minimal member population behavior.

Copyright (c) 2016 Cisco Systems, Inc. and others. All rights reserved.

This program and the accompanying materials are made available under the terms of the Eclipse Public License v1.0 which accompanies this distribution, and is available at http://www.eclipse.org/legal/epl-v10.html

This test stops majority of the followers and verifies car addition is not possible, then resumes single follower (first from original list) and checks that addition works. Then remaining members are brought up. Leader member is always up and assumed to remain Leading during the whole suite run.

TODO: Use initial data to check more operations. TODO: Perhaps merge with car_failover_crud suite.

Other modules and Shards (people, car-people) are not accessed by this suite.

All data is deleted at the end of the suite. This suite expects car module to have a separate Shard.
Source: /w/workspace/controller-csit-3node-clustering-ask-all-calcium/test/csit/suites/controller/Clustering_Datastore/car_outage_corners.robot
Start / End / Elapsed: 20250309 02:05:20.914 / 20250309 02:05:26.073 / 00:00:05.159
Status: 8 tests total, 0 passed, 8 failed, 0 skipped
Message: Suite setup failed: ConnectionError: HTTPConnectionPool(host='10.30.171.20', port=8181): Max retries exceeded with url: /rests/data/ietf-yang-library:modules-state?content=nonconfig (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fba73f01490>: Failed to establish a new connection: [Errno 111] Connection refused'))