Test Statistics

Total Statistics
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
All Tests
927000:08:59
Statistics by Tag
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
No Tags
Statistics by Suite
Total
Pass
Fail
Skip
Elapsed
Pass / Fail / Skip
927000:09:00

Test Execution Log

00:08:59.996 SUITE openflowplugin-clustering-perf-bulkomatic.txt
00:00:00.023 SETUP ClusterManagement . ClusterManagement_Setup  
00:00:00.000 TEARDOWN RequestsLibrary . Delete All Sessions  
00:00:00.024 TEST Check Shards Status And Initialize Variables
00:00:00.022 KEYWORD ClusterOpenFlow . Check OpenFlow Shards Status  
00:00:00.009 KEYWORD CompareStream . Run_Keyword_If_At_Least_Phosphorus   Collections.Remove Values From List ${SHARD_OPER_LIST} entity-ownership
00:00:00.009 KEYWORD BuiltIn . Run Keyword And Return   Run_Keyword_If_At_Least phosphorus ${kw_name} @{varargs} &{kwargs}
00:00:00.001 KEYWORD CompareStream . Run_Keyword_If_At_Least   phosphorus ${kw_name} @{varargs} &{kwargs}
00:00:00.000 KEYWORD BuiltIn . Run Keyword And Return If   ${Stream_dict}[${ODL_STREAM}] >= ${Stream_dict}[${lower_bound}] ${kw_name} @{varargs} &{kwargs}
02:23:07.788 FAIL Dictionary '${Stream_dict}' has no key 'titanium'.
02:23:07.788 INFO Returning from the enclosing user keyword.
00:00:00.000 KEYWORD BuiltIn . Log   ${SHARD_OPER_LIST}
00:00:00.000 KEYWORD ClusterManagement . Verify_Leader_Exists_For_Each_Shard   shard_name_list=${SHARD_OPER_LIST} shard_type=operational member_index_list=${controller_index_list}
00:00:00.000 KEYWORD ClusterManagement . Verify_Leader_Exists_For_Each_Shard   shard_name_list=${SHARD_CONF_LIST} shard_type=config member_index_list=${controller_index_list}
00:00:00.000 KEYWORD BuiltIn . Wait Until Keyword Succeeds   3x 3s ClusterManagement.Run_Karaf_Command_On_List_Or_All ${karaf_log_level}
00:00:00.000 KEYWORD ${flow_count_after_add} = BuiltIn . Evaluate   ${flow_count_per_switch} * ${switch_count}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${flow_count_after_add}
00:00:00.000 KEYWORD ${temp_json_config_add} = BulkomaticKeywords . Set DPN And Flow Count In Json Add   ${orig_json_config_add} ${switch_count} ${flow_count_per_switch}
00:00:00.000 KEYWORD ${temp_json_config_get} = BulkomaticKeywords . Set DPN And Flow Count In Json Get   ${orig_json_config_get} ${switch_count} ${flow_count_after_add}
00:00:00.000 KEYWORD ${temp_json_config_del} = BulkomaticKeywords . Set DPN And Flow Count In Json Del   ${orig_json_config_del} ${switch_count} ${flow_count_per_switch}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${temp_json_config_add}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${temp_json_config_get}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${temp_json_config_del}
00:00:07.261 TEST Get Inventory Config Shard Follower And Leader
00:00:07.068 TEST Start Mininet Connect To Follower Node1
00:00:00.011 TEST Add Bulk Flow From Follower Node2
00:00:00.000 KEYWORD ${config_datastore_write_start_time} = DateTime . Get Current Date   result_format=timestamp
00:00:00.004 KEYWORD BulkomaticKeywords . Add Bulk Flow In Node   ${temp_json_config_add} ${Follower_Node_2} ${operation_timeout}
02:23:22.131 FAIL Variable '${temp_json_config_add}' not found.
00:00:00.000 KEYWORD ${config_datastore_write_end_time} = DateTime . Get Current Date   result_format=timestamp
00:00:00.000 KEYWORD ${config_datastore_write_time} = DateTime . Subtract Date From Date   ${config_datastore_write_end_time} ${config_datastore_write_start_time}
00:00:00.000 KEYWORD ${config_datastore_write_rate} = BuiltIn . Evaluate   ${flow_count_after_add} / ${config_datastore_write_time}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${config_datastore_write_start_time}
00:00:00.000 KEYWORD BuiltIn . Log To Console   ${\n}
00:00:00.000 KEYWORD BuiltIn . Log To Console   The config_datastore_write_time is ${config_datastore_write_time}
00:00:00.000 KEYWORD BuiltIn . Log To Console   The config_datastore_write_rate is ${config_datastore_write_rate}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${config_datastore_write_time}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${config_datastore_write_rate}
00:00:00.007 TEST Verify Flows In Switch
00:00:00.000 KEYWORD ${Mininet_write_start_time} = DateTime . Get Current Date   result_format=timestamp
00:00:00.004 KEYWORD MininetKeywords . Verify Aggregate Flow From Mininet Session   ${mininet_conn_id} ${flow_count_after_add} ${operation_timeout}
02:23:22.138 FAIL Variable '${flow_count_after_add}' not found.
00:00:00.000 KEYWORD ${Mininet_write_end_time} = DateTime . Get Current Date   result_format=timestamp
00:00:00.000 KEYWORD ${Mininet_write_time} = DateTime . Subtract Date From Date   ${Mininet_write_end_time} ${config_datastore_write_start_time}
00:00:00.000 KEYWORD ${Mininet_write_rate} = BuiltIn . Evaluate   ${flow_count_after_add} / ${Mininet_write_time}
00:00:00.000 KEYWORD BuiltIn . Log To Console   ${\n}
00:00:00.000 KEYWORD BuiltIn . Log To Console   The Mininet_write_time is ${Mininet_write_time}
00:00:00.000 KEYWORD BuiltIn . Log To Console   The Mininet_write_rate is ${Mininet_write_rate}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${Mininet_write_time}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${Mininet_write_rate}
00:06:40.947 TEST Verify Flows In Oper DS
00:06:40.945 KEYWORD BuiltIn . Wait Until Keyword Succeeds   ${oper_ds_timeout} 2s ClusterOpenFlow.Check_Flows_Operational_Datastore_On_Member ${flow_count_after_add} ${Inventory_Leader}
00:00:00.005 KEYWORD ClusterOpenFlow . Check Flows Operational Datastore On Member   ${flow_count_after_add} ${Inventory_Leader}
02:30:03.084 FAIL Variable '${flow_count_after_add}' not found.
02:30:03.085 FAIL Keyword 'ClusterOpenFlow.Check_Flows_Operational_Datastore_On_Member' failed after retrying for 6 minutes 40 seconds. The last error was: Variable '${flow_count_after_add}' not found.
00:00:00.000 KEYWORD ${oper_datastore_write_end_time} = DateTime . Get Current Date   result_format=timestamp
00:00:00.000 KEYWORD ${oper_datastore_write_time} = DateTime . Subtract Date From Date   ${oper_datastore_write_end_time} ${config_datastore_write_start_time}
00:00:00.000 KEYWORD ${oper_datastore_write_rate} = BuiltIn . Evaluate   ${flow_count_after_add} / ${oper_datastore_write_time}
00:00:00.000 KEYWORD BuiltIn . Log To Console   ${\n}
00:00:00.000 KEYWORD BuiltIn . Log To Console   The oper_datastore_write_time is ${oper_datastore_write_time}
00:00:00.000 KEYWORD BuiltIn . Log To Console   The oper_datastore_write_rate is ${oper_datastore_write_rate}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${oper_datastore_write_time}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${oper_datastore_write_rate}
00:02:04.064 TEST Stop Mininet Connected To Follower Node1 After Reconcilliation
00:00:02.328 KEYWORD MininetKeywords . Stop Mininet And Exit   ${mininet_conn_id}
00:02:01.731 KEYWORD BuiltIn . Wait Until Keyword Succeeds   ${mininet_timeout} 2s ClusterOpenFlow.Verify_Switch_Connections_Running_On_Member 0 ${Inventory_Leader}
00:00:00.027 KEYWORD ClusterOpenFlow . Verify Switch Connections Running On Member   0 ${Inventory_Leader}
00:00:00.024 KEYWORD ${count} = ScaleClient . Get Switches Count   controller=${ODL_SYSTEM_${member_index}_IP}
00:00:00.001 KEYWORD BuiltIn . Should Be Equal As Numbers   ${switch_count} ${count}
02:32:07.151 INFO Argument types are: <class 'str'> <class 'int'>
02:32:07.151 FAIL 0.0 != 2.0
02:32:07.152 FAIL Keyword 'ClusterOpenFlow.Verify_Switch_Connections_Running_On_Member' failed after retrying for 2 minutes. The last error was: 0.0 != 2.0
00:00:00.014 TEST Delete All Flows From Follower Node2
00:00:00.000 KEYWORD ${config_datastore_delete_start_time} = DateTime . Get Current Date   result_format=timestamp
00:00:00.005 KEYWORD BulkomaticKeywords . Delete Bulk Flow In Node   ${temp_json_config_del} ${Follower_Node_2} ${operation_timeout}
02:32:07.165 FAIL Variable '${temp_json_config_del}' not found.
00:00:00.000 KEYWORD ${config_datastore_delete_end_time} = DateTime . Get Current Date   result_format=timestamp
00:00:00.000 KEYWORD ${config_datastore_delete_time} = DateTime . Subtract Date From Date   ${config_datastore_delete_end_time} ${config_datastore_delete_start_time}
00:00:00.000 KEYWORD ${config_datastore_delete_rate} = BuiltIn . Evaluate   ${flow_count_after_add} / ${config_datastore_delete_time}
00:00:00.000 KEYWORD BuiltIn . Log To Console   ${\n}
00:00:00.000 KEYWORD BuiltIn . Log To Console   The config_datastore_delete_time is ${config_datastore_delete_time}
00:00:00.000 KEYWORD BuiltIn . Log To Console   The config_datastore_delete_rate is ${config_datastore_delete_rate}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${config_datastore_delete_time}
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable   ${config_datastore_delete_rate}
00:00:00.006 TEST Log Results And Determine Status
00:00:00.001 KEYWORD OperatingSystem . Append To File   ${rate_results_file} Config DS,OVS Switch,Operational DS\n
00:00:00.004 KEYWORD OperatingSystem . Append To File   ${rate_results_file} ${config_datastore_write_rate},${Mininet_write_rate},${oper_datastore_write_rate}\n
02:32:07.172 FAIL Variable '${config_datastore_write_rate}' not found.
00:00:00.000 KEYWORD OperatingSystem . Append To File   ${time_results_file} Config DS,OVS Switch,Operational DS\n
00:00:00.000 KEYWORD OperatingSystem . Append To File   ${time_results_file} ${config_datastore_write_time},${Mininet_write_time},${oper_datastore_write_time}\n