Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 1 | *** Settings *** |
| 2 | |
| 3 | Documentation Test BMC dump functionality of OpenBMC. |
| 4 | |
George Keishing | 88ec280 | 2021-08-04 03:04:22 -0500 | [diff] [blame] | 5 | Resource ../../lib/bmc_redfish_resource.robot |
| 6 | Resource ../../lib/boot_utils.robot |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 7 | Resource ../../lib/dump_utils.robot |
George Keishing | 88ec280 | 2021-08-04 03:04:22 -0500 | [diff] [blame] | 8 | Resource ../../lib/openbmc_ffdc.robot |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 9 | |
George Keishing | f514ccb | 2021-02-02 23:55:56 -0600 | [diff] [blame] | 10 | Suite Setup Redfish.Login |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 11 | Test Setup Redfish Delete All BMC Dumps |
| 12 | Test Teardown Test Teardown Execution |
| 13 | |
Tim Lee | de2d130 | 2021-06-18 01:24:11 +0800 | [diff] [blame] | 14 | *** Variables *** |
| 15 | |
| 16 | # Total size of the dump in kilo bytes |
| 17 | ${BMC_DUMP_TOTAL_SIZE} ${1024} |
| 18 | |
| 19 | # Minimum space required for one bmc dump in kilo bytes |
| 20 | ${BMC_DUMP_MIN_SPACE_REQD} ${20} |
manashsarma | bd346b3 | 2022-07-20 06:22:58 -0500 | [diff] [blame] | 21 | ${MAX_DUMP_COUNT} ${20} |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 22 | |
| 23 | *** Test Cases *** |
| 24 | |
manashsarma | 4b5b1fa | 2022-11-16 02:36:58 -0600 | [diff] [blame] | 25 | Verify Error Response For Already Deleted Dump Id |
| 26 | [Documentation] Delete non existing BMC dump and expect an error. |
| 27 | [Tags] Verify_Error_Response_For_Already_Deleted_Dump_Id |
| 28 | |
| 29 | ${dump_id}= Create User Initiated BMC Dump Via Redfish |
| 30 | Redfish Delete BMC Dump ${dump_id} |
| 31 | Run Keyword And Expect Error ValueError: * Redfish Delete BMC Dump ${dump_id} |
| 32 | |
| 33 | |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 34 | Verify User Initiated BMC Dump When Host Powered Off |
| 35 | [Documentation] Create user initiated BMC dump at host off state and |
| 36 | ... verify dump entry for it. |
| 37 | [Tags] Verify_User_Initiated_BMC_Dump_When_Host_Powered_Off |
| 38 | |
| 39 | Redfish Power Off stack_mode=skip |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 40 | ${dump_id}= Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | bcefdf2 | 2020-10-16 07:51:34 -0500 | [diff] [blame] | 41 | ${dump_entries}= Get BMC Dump Entries |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 42 | Length Should Be ${dump_entries} 1 |
| 43 | List Should Contain Value ${dump_entries} ${dump_id} |
| 44 | |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 45 | |
Rahul Maheshwari | e8e9d0c | 2020-10-30 02:39:01 -0500 | [diff] [blame] | 46 | Verify User Initiated BMC Dump Size |
manashsarma | 7831dc2 | 2022-03-08 01:49:36 -0600 | [diff] [blame] | 47 | [Documentation] Verify user initiated BMC dump size is under 20 MB. |
Rahul Maheshwari | e8e9d0c | 2020-10-30 02:39:01 -0500 | [diff] [blame] | 48 | [Tags] Verify_User_Initiated_BMC_Dump_Size |
| 49 | |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 50 | ${dump_id}= Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | e8e9d0c | 2020-10-30 02:39:01 -0500 | [diff] [blame] | 51 | ${resp}= Redfish.Get Properties /redfish/v1/Managers/bmc/LogServices/Dump/Entries/${dump_id} |
| 52 | |
| 53 | # Example of response from above Redfish GET request. |
| 54 | # "@odata.type": "#LogEntry.v1_7_0.LogEntry", |
| 55 | # "AdditionalDataSizeBytes": 31644, |
| 56 | # "AdditionalDataURI": "/redfish/v1/Managers/bmc/LogServices/Dump/attachment/9", |
| 57 | # "Created": "2020-10-23T06:32:53+00:00", |
| 58 | # "DiagnosticDataType": "Manager", |
| 59 | # "EntryType": "Event", |
| 60 | # "Id": "9", |
| 61 | # "Name": "BMC Dump Entry" |
| 62 | |
manashsarma | 7831dc2 | 2022-03-08 01:49:36 -0600 | [diff] [blame] | 63 | # Max size for dump is 20 MB = 20x1024x1024 Byte. |
| 64 | Should Be True 0 < ${resp["AdditionalDataSizeBytes"]} < 20971520 |
Rahul Maheshwari | e8e9d0c | 2020-10-30 02:39:01 -0500 | [diff] [blame] | 65 | |
| 66 | |
George Keishing | 3d85098 | 2022-07-19 11:03:03 -0500 | [diff] [blame] | 67 | Verify User Initiated BMC Dump When Host Booted |
| 68 | [Documentation] Create user initiated BMC dump at host booted state and |
| 69 | ... verify dump entry for it. |
| 70 | [Tags] Verify_User_Initiated_BMC_Dump_When_Host_Booted |
| 71 | |
| 72 | Redfish Power On stack_mode=skip |
| 73 | ${dump_id}= Create User Initiated BMC Dump Via Redfish |
| 74 | ${dump_entries}= Get BMC Dump Entries |
| 75 | Length Should Be ${dump_entries} 1 |
| 76 | List Should Contain Value ${dump_entries} ${dump_id} |
| 77 | |
| 78 | |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 79 | Verify Dump Persistency On Dump Service Restart |
| 80 | [Documentation] Create user dump, restart dump manager service and verify dump |
| 81 | ... persistency. |
| 82 | [Tags] Verify_Dump_Persistency_On_Dump_Service_Restart |
| 83 | |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 84 | Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 85 | ${dump_entries_before}= redfish_utils.get_member_list /redfish/v1/Managers/bmc/LogServices/Dump/Entries |
| 86 | |
| 87 | # Restart dump service. |
| 88 | BMC Execute Command systemctl restart xyz.openbmc_project.Dump.Manager.service |
| 89 | Sleep 10s reason=Wait for BMC dump service to restart properly |
| 90 | |
| 91 | ${dump_entries_after}= redfish_utils.get_member_list /redfish/v1/Managers/bmc/LogServices/Dump/Entries |
| 92 | Lists Should Be Equal ${dump_entries_before} ${dump_entries_after} |
| 93 | |
| 94 | |
| 95 | Verify Dump Persistency On BMC Reset |
| 96 | [Documentation] Create user dump, reset BMC and verify dump persistency. |
| 97 | [Tags] Verify_Dump_Persistency_On_BMC_Reset |
| 98 | |
manashsarma | 8fa9c89 | 2022-10-03 06:20:58 -0500 | [diff] [blame] | 99 | # Power off host so that dump is not offloaded to host OS. |
| 100 | Redfish Power Off stack_mode=skip |
| 101 | |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 102 | Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 103 | ${dump_entries_before}= redfish_utils.get_member_list /redfish/v1/Managers/bmc/LogServices/Dump/Entries |
| 104 | |
| 105 | # Reset BMC. |
George Keishing | 88ec280 | 2021-08-04 03:04:22 -0500 | [diff] [blame] | 106 | OBMC Reboot (off) stack_mode=skip |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 107 | |
| 108 | ${dump_entries_after}= redfish_utils.get_member_list /redfish/v1/Managers/bmc/LogServices/Dump/Entries |
| 109 | Lists Should Be Equal ${dump_entries_before} ${dump_entries_after} |
| 110 | |
| 111 | |
Rahul Maheshwari | 95cbceb | 2020-10-21 23:25:08 -0500 | [diff] [blame] | 112 | Delete User Initiated BMC Dump And Verify |
| 113 | [Documentation] Delete user initiated BMC dump and verify. |
| 114 | [Tags] Delete_User_Initiated_BMC_Dump_And_Verify |
| 115 | |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 116 | ${dump_id}= Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | 95cbceb | 2020-10-21 23:25:08 -0500 | [diff] [blame] | 117 | Redfish Delete BMC Dump ${dump_id} |
| 118 | |
| 119 | ${dump_entries}= Get BMC Dump Entries |
| 120 | Should Be Empty ${dump_entries} |
| 121 | |
| 122 | |
| 123 | Delete All User Initiated BMC Dumps And Verify |
| 124 | [Documentation] Delete all user initiated BMC dumps and verify. |
| 125 | [Tags] Delete_All_User_Initiated_BMC_Dumps_And_Verify |
| 126 | |
manashsarma | 70d840e | 2022-10-18 02:34:45 -0500 | [diff] [blame] | 127 | # Power off host so that dump is not offloaded to host OS. |
| 128 | Redfish Power Off stack_mode=skip |
| 129 | |
Rahul Maheshwari | 95cbceb | 2020-10-21 23:25:08 -0500 | [diff] [blame] | 130 | # Create some BMC dump. |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 131 | Create User Initiated BMC Dump Via Redfish |
| 132 | Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | 95cbceb | 2020-10-21 23:25:08 -0500 | [diff] [blame] | 133 | |
| 134 | Redfish Delete All BMC Dumps |
| 135 | ${dump_entries}= Get BMC Dump Entries |
| 136 | Should Be Empty ${dump_entries} |
| 137 | |
| 138 | |
Rahul Maheshwari | 4f338ab | 2020-10-21 23:28:40 -0500 | [diff] [blame] | 139 | Create Two User Initiated BMC Dumps |
| 140 | [Documentation] Create two user initiated BMC dumps. |
| 141 | [Tags] Create_Two_User_Initiated_BMC_Dumps |
| 142 | |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 143 | ${dump_id1}= Create User Initiated BMC Dump Via Redfish |
| 144 | ${dump_id2}= Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | 4f338ab | 2020-10-21 23:28:40 -0500 | [diff] [blame] | 145 | |
| 146 | ${dump_entries}= Get BMC Dump Entries |
| 147 | Length Should Be ${dump_entries} 2 |
| 148 | Should Contain ${dump_entries} ${dump_id1} |
| 149 | Should Contain ${dump_entries} ${dump_id2} |
| 150 | |
| 151 | |
| 152 | Create Two User Initiated BMC Dumps And Delete One |
| 153 | [Documentation] Create two dumps and delete the first. |
| 154 | [Tags] Create_Two_User_Initiated_BMC_Dumps_And_Delete_One |
| 155 | |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 156 | ${dump_id1}= Create User Initiated BMC Dump Via Redfish |
| 157 | ${dump_id2}= Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | 4f338ab | 2020-10-21 23:28:40 -0500 | [diff] [blame] | 158 | |
| 159 | Redfish Delete BMC Dump ${dump_id1} |
| 160 | |
| 161 | ${dump_entries}= Get BMC Dump Entries |
| 162 | Length Should Be ${dump_entries} 1 |
| 163 | List Should Contain Value ${dump_entries} ${dump_id2} |
| 164 | |
| 165 | |
| 166 | Create And Delete User Initiated BMC Dump Multiple Times |
| 167 | [Documentation] Create and delete user initiated BMC dump multiple times. |
| 168 | [Tags] Create_And_Delete_User_Initiated_BMC_Dump_Multiple_Times |
| 169 | |
| 170 | FOR ${INDEX} IN 1 10 |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 171 | ${dump_id}= Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | 4f338ab | 2020-10-21 23:28:40 -0500 | [diff] [blame] | 172 | Redfish Delete BMC Dump ${dump_id} |
| 173 | END |
| 174 | |
| 175 | |
Rahul Maheshwari | d709c8d | 2020-11-01 23:03:51 -0600 | [diff] [blame] | 176 | Verify Maximum BMC Dump Creation |
| 177 | [Documentation] Create maximum BMC dump and verify error when dump runs out of space. |
| 178 | [Tags] Verify_Maximum_BMC_Dump_Creation |
| 179 | [Teardown] Redfish Delete All BMC Dumps |
| 180 | |
| 181 | # Maximum allowed space for dump is 1024 KB. BMC typically hold 8-14 dumps |
| 182 | # before running out of this dump space. So trying to create dumps in 20 |
| 183 | # iterations to run out of space. |
manashsarma | bd346b3 | 2022-07-20 06:22:58 -0500 | [diff] [blame] | 184 | # User can key in the Maximum allowed space for bmc dump and how many iteration. |
| 185 | FOR ${n} IN RANGE 0 ${MAX_DUMP_COUNT} |
Rahul Maheshwari | bd38aa4 | 2021-08-04 01:24:39 -0500 | [diff] [blame] | 186 | Create User Initiated BMC Dump Via Redfish |
Rahul Maheshwari | d709c8d | 2020-11-01 23:03:51 -0600 | [diff] [blame] | 187 | ${dump_space}= Get Disk Usage For Dumps |
Tim Lee | de2d130 | 2021-06-18 01:24:11 +0800 | [diff] [blame] | 188 | Exit For Loop If ${dump_space} >= (${BMC_DUMP_TOTAL_SIZE} - ${BMC_DUMP_MIN_SPACE_REQD}) |
Rahul Maheshwari | d709c8d | 2020-11-01 23:03:51 -0600 | [diff] [blame] | 189 | END |
| 190 | |
| 191 | # Check error while creating dump when dump size is full. |
| 192 | ${payload}= Create Dictionary DiagnosticDataType=Manager |
| 193 | Redfish.Post /redfish/v1/Managers/bmc/LogServices/Dump/Actions/LogService.CollectDiagnosticData |
| 194 | ... body=${payload} valid_status_codes=[${HTTP_INTERNAL_SERVER_ERROR}] |
| 195 | |
| 196 | |
manashsarma | 633cac9 | 2022-11-25 03:27:03 -0600 | [diff] [blame] | 197 | Verify BMC Core Dump When Host Powered Off |
| 198 | [Documentation] Verify BMC core dump after application crash at host powered off state. |
| 199 | [Tags] Verify_BMC_Core_Dump_When_Host_Powered_Off |
| 200 | |
| 201 | Redfish Power Off stack_mode=skip |
| 202 | |
| 203 | # Ensure all dumps are cleaned out. |
| 204 | Redfish Delete All BMC Dumps |
| 205 | Trigger Core Dump |
| 206 | |
| 207 | # Verify that BMC dump is available. |
| 208 | Wait Until Keyword Succeeds 2 min 10 sec Is BMC Dump Available |
| 209 | |
| 210 | |
manashsarma | 849189c | 2022-11-28 04:16:51 -0600 | [diff] [blame^] | 211 | Verify Core Dump Size |
| 212 | [Documentation] Verify BMC core dump size is under 20 MB. |
| 213 | [Tags] Verify_Core_Dump_Size |
| 214 | |
| 215 | Redfish Power Off stack_mode=skip |
| 216 | |
| 217 | # Ensure all dumps are cleaned out. |
| 218 | Redfish Delete All BMC Dumps |
| 219 | Trigger Core Dump |
| 220 | |
| 221 | # Verify that BMC dump is available. |
| 222 | Wait Until Keyword Succeeds 2 min 10 sec Is BMC Dump Available |
| 223 | ${dump_entries}= Get BMC Dump Entries |
| 224 | ${resp}= Redfish.Get Properties |
| 225 | ... /redfish/v1/Managers/bmc/LogServices/Dump/Entries/${dump_entries[0]} |
| 226 | |
| 227 | # Max size for dump is 20 MB = 20x1024x1024 Byte. |
| 228 | Should Be True 0 < ${resp["AdditionalDataSizeBytes"]} < 20971520 |
| 229 | |
| 230 | |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 231 | *** Keywords *** |
| 232 | |
Rahul Maheshwari | bcefdf2 | 2020-10-16 07:51:34 -0500 | [diff] [blame] | 233 | Get BMC Dump Entries |
| 234 | [Documentation] Return BMC dump ids list. |
| 235 | |
| 236 | ${dump_uris}= redfish_utils.get_member_list /redfish/v1/Managers/bmc/LogServices/Dump/Entries |
| 237 | ${dump_ids}= Create List |
| 238 | |
| 239 | FOR ${dump_uri} IN @{dump_uris} |
| 240 | ${dump_id}= Fetch From Right ${dump_uri} / |
| 241 | Append To List ${dump_ids} ${dump_id} |
| 242 | END |
| 243 | |
| 244 | [Return] ${dump_ids} |
| 245 | |
| 246 | |
manashsarma | 633cac9 | 2022-11-25 03:27:03 -0600 | [diff] [blame] | 247 | Is BMC Dump Available |
| 248 | [Documentation] Verify if BMC dump is available. |
| 249 | |
| 250 | ${dump_entries}= Get BMC Dump Entries |
| 251 | |
| 252 | # Verifying that BMC dump is available. |
| 253 | ${length}= Get length ${dump_entries} |
| 254 | Should Be True 0 < ${length} |
| 255 | |
| 256 | |
Rahul Maheshwari | d709c8d | 2020-11-01 23:03:51 -0600 | [diff] [blame] | 257 | Get Disk Usage For Dumps |
| 258 | [Documentation] Return disk usage in kilobyte for BMC dumps. |
| 259 | |
| 260 | ${usage_output} ${stderr} ${rc}= BMC Execute Command du -s /var/lib/phosphor-debug-collector/dumps |
| 261 | |
| 262 | # Example of output from above BMC cli command. |
| 263 | # $ du -s /var/lib/phosphor-debug-collector/dumps |
| 264 | # 516 /var/lib/phosphor-debug-collector/dumps |
| 265 | |
| 266 | ${usage_output}= Fetch From Left ${usage_output} / |
| 267 | ${usage_output}= Convert To Integer ${usage_output} |
| 268 | |
| 269 | [return] ${usage_output} |
| 270 | |
| 271 | |
Rahul Maheshwari | 2568f87 | 2020-09-23 01:03:39 -0500 | [diff] [blame] | 272 | Test Teardown Execution |
| 273 | [Documentation] Do test teardown operation. |
| 274 | |
| 275 | FFDC On Test Case Fail |
| 276 | Close All Connections |