blob: c659300a5a08aa29f8a4385c166c90a67fcf1d29 [file] [log] [blame]
Rahul Maheshwariad676bf2017-06-22 15:06:05 -05001*** Settings ***
2
3Documentation Test dump functionality of OpenBMC.
4
George Keishingfb3f9a52019-07-18 13:13:58 -05005Resource ../../lib/openbmc_ffdc.robot
6Resource ../../lib/rest_client.robot
7Resource ../../lib/dump_utils.robot
8Resource ../../lib/boot_utils.robot
9Resource ../../lib/utils.robot
George Keishingbac0c572019-08-08 23:19:45 -050010Resource ../../lib/state_manager.robot
George Keishingfb3f9a52019-07-18 13:13:58 -050011Library ../../lib/bmc_ssh_utils.py
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050012
13Test Setup Open Connection And Log In
George Keishing40b7ee02017-11-13 05:12:41 -060014Test Teardown Test Teardown Execution
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050015
16*** Test Cases ***
17
Sivas SRRc0957412017-10-06 13:02:08 -050018Pre Dump BMC Performance Test
19 [Documentation] Check performance of memory, CPU & file system of BMC.
20 [Tags] Pre_Dump_BMC_Performance_Test
21
22 Open Connection And Log In
23 Check BMC Performance
24
George Keishing40b7ee02017-11-13 05:12:41 -060025
Rahul Maheshwari355f2702017-10-17 09:15:23 -050026Verify User Initiated BMC Dump When Powered Off
27 [Documentation] Create user initiated BMC dump at host off state and
28 ... verify dump entry for it.
29 [Tags] Verify_User_Initiated_BMC_Dump_When_Powered_Off
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050030
George Keishingfb3f9a52019-07-18 13:13:58 -050031 Redfish Power Off stack_mode=skip
Sivas SRR7aabd792017-10-18 21:28:23 -050032 ${dump_id}= Create User Initiated Dump
Steven Sombar336fa972019-11-07 13:12:58 -060033 Check Existence Of BMC Dump File ${dump_id}
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050034
Steven Sombara011c022019-01-16 18:13:52 -060035
George Keishinga2dab9f2017-09-05 13:54:01 -050036Verify Dump Persistency On Service Restart
37 [Documentation] Create user dump, restart BMC service and verify dump
38 ... persistency.
39 [Tags] Verify_Dump_Persistency_On_Service_Restart
40
George Keishingfee18cf2017-09-20 09:46:00 -050041 Delete All BMC Dump
Sivas SRR7aabd792017-10-18 21:28:23 -050042 ${dump_id}= Create User Initiated Dump
George Keishinga2dab9f2017-09-05 13:54:01 -050043 BMC Execute Command
44 ... systemctl restart xyz.openbmc_project.Dump.Manager.service
45 Sleep 10s reason=Wait for BMC dump service to restart properly.
46
Steven Sombaraaaab222018-12-19 13:16:23 -060047 ${resp}= OpenBMC Get Request ${DUMP_ENTRY_URI}list
George Keishinga2dab9f2017-09-05 13:54:01 -050048 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
Steven Sombar336fa972019-11-07 13:12:58 -060049 Check Existence Of BMC Dump File ${dump_id}
Sivas SRR7aabd792017-10-18 21:28:23 -050050
51
52Verify Dump Persistency On Reset
53 [Documentation] Create user dump, reset BMC and verify dump persistency.
54 [Tags] Verify_Dump_Persistency_On_Reset
55
56 Delete All BMC Dump
57 ${dump_id}= Create User Initiated Dump
58 OBMC Reboot (off)
Steven Sombaraaaab222018-12-19 13:16:23 -060059 ${resp}= OpenBMC Get Request ${DUMP_ENTRY_URI}list
Sivas SRR7aabd792017-10-18 21:28:23 -050060 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
Steven Sombar336fa972019-11-07 13:12:58 -060061 Check Existence Of BMC Dump File ${dump_id}
George Keishinga2dab9f2017-09-05 13:54:01 -050062
63
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050064Delete User Initiated BMC Dump And Verify
65 [Documentation] Delete user initiated dump and verify.
66 [Tags] Delete_User_Initiated_Dump_And_Verify
67
68 ${dump_id}= Create User Initiated Dump
Steven Sombar336fa972019-11-07 13:12:58 -060069 Check Existence Of BMC Dump File ${dump_id}
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050070
71 Delete BMC Dump ${dump_id}
72
73
74Verify User Initiated Dump Size
George Keishing6db52022017-08-22 00:39:22 -050075 [Documentation] Verify user Initiated BMC dump size is under 200k.
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050076 [Tags] Verify_User_Initiated_Dump_Size
77
78 ${dump_id}= Create User Initiated Dump
79
Steven Sombaraaaab222018-12-19 13:16:23 -060080 ${dump_size}= Read Attribute ${DUMP_ENTRY_URI}${dump_id} Size
George Keishing6db52022017-08-22 00:39:22 -050081 # Max size for dump is 200k = 200x1024
82 Should Be True 0 < ${dump_size} < 204800
Steven Sombar336fa972019-11-07 13:12:58 -060083 Check Existence Of BMC Dump File ${dump_id}
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050084
85
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050086Create Two User Initiated Dump And Delete One
87 [Documentation] Create two dumps and delete the first.
88 [Tags] Create_Two_User_Initiated_Dump_And_Delete_One
89
90 ${dump_id_1}= Create User Initiated Dump
91 ${dump_id_2}= Create User Initiated Dump
92
93 Delete BMC Dump ${dump_id_1}
94
Steven Sombaraaaab222018-12-19 13:16:23 -060095 ${resp}= OpenBMC Get Request ${DUMP_ENTRY_URI}${dump_id_1}
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050096 Should Be Equal As Strings ${resp.status_code} ${HTTP_NOT_FOUND}
97
Steven Sombaraaaab222018-12-19 13:16:23 -060098 ${resp}= OpenBMC Get Request ${DUMP_ENTRY_URI}${dump_id_2}
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050099 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
Steven Sombar336fa972019-11-07 13:12:58 -0600100 Check Existence Of BMC Dump File ${dump_id_2}
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500101
102
Rahul Maheshwari0dafbb42017-08-22 13:17:52 -0500103Create And Delete BMC Dump Multiple Times
104 [Documentation] Create and delete BMC dump multiple times.
105 [Tags] Create_And_Delete_BMC_Dump_Multiple_Times
106
107 :FOR ${INDEX} IN RANGE 1 5
108 \ ${dump_id}= Create User Initiated Dump
Rahul Maheshwari0dafbb42017-08-22 13:17:52 -0500109 \ Delete BMC Dump ${dump_id}
110
111
112Delete All BMC Dumps And Verify
113 [Documentation] Delete all BMC dumps and verify.
114 [Tags] Delete_All_BMC_Dumps_And_Verify
115
116 # Create some dump.
117 Create User Initiated Dump
118 Create User Initiated Dump
119
George Keishingfee18cf2017-09-20 09:46:00 -0500120 Delete All BMC Dump
Steven Sombaraaaab222018-12-19 13:16:23 -0600121 ${resp}= OpenBMC Get Request ${DUMP_ENTRY_URI}list
Rahul Maheshwari0dafbb42017-08-22 13:17:52 -0500122 Should Be Equal As Strings ${resp.status_code} ${HTTP_NOT_FOUND}
123
George Keishing40b7ee02017-11-13 05:12:41 -0600124
125Verify User Initiated BMC Dump When Host Booted
126 [Documentation] Create user initiated BMC dump at host booted state and
127 ... verify dump entry for it.
128 [Tags] Verify_User_Initiated_BMC_Dump_When_Host_Booted
129
George Keishingfb3f9a52019-07-18 13:13:58 -0500130 Redfish Power On stack_mode=skip
George Keishing40b7ee02017-11-13 05:12:41 -0600131 Create User Initiated Dump
132
133
Rahul Maheshwari1612ac92017-08-30 14:42:32 -0500134Verify Core Dump Size
135 [Documentation] Verify BMC core dump size is under 200k.
136 [Tags] Verify_Core_Dump_Size
137
138 Delete All Dumps
139 Trigger Core Dump
George Keishing40efd762018-10-22 04:04:00 -0500140 Wait Until Keyword Succeeds 2 min 10 sec Get Dump Entries
Rahul Maheshwari1612ac92017-08-30 14:42:32 -0500141
142 ${dump_entries}= Get URL List ${DUMP_ENTRY_URI}
143 ${dump_size}= Read Attribute ${dump_entries[0]} Size
144
145 # Max size for dump is 200k = 200x1024
146 Should Be True 0 < ${dump_size} < 204800 msg=Size of dump is incorrect.
147
148
Steven Sombara011c022019-01-16 18:13:52 -0600149Dump Out Of Space Test
150 [Documentation] Verify out of dump space is reported when attempt
151 ... to create too many dumps.
152 [Tags] Dump_Out_Of_Space_Test
George Keishingda67cdd2019-08-26 23:40:57 -0500153 [Setup] Delete All BMC Dump
Steven Sombara011c022019-01-16 18:13:52 -0600154
155 # Systems typically hold 8-14 dumps before running out of dump space.
156 # Attempt to create too_many_dumps. Expect to run out of space
157 # before this.
George Keishing656eb4a2019-09-03 03:48:01 -0500158 ${too_many_dumps} Set Variable ${20}
Steven Sombara011c022019-01-16 18:13:52 -0600159
160 # Loop, creating a dump each iteration. Will either get dump_id or
161 # will get EMPTY when out of dump space.
162 :FOR ${n} IN RANGE ${too_many_dumps}
163 \ ${dump_id}= Create User Initiated Dump check_out_of_space=${True}
164 \ Exit For Loop If '${dump_id}' == '${EMPTY}'
Steven Sombar336fa972019-11-07 13:12:58 -0600165 \ Check Existence Of BMC Dump File ${dump_id}
Steven Sombara011c022019-01-16 18:13:52 -0600166
167 Run Keyword If '${dump_id}' != '${EMPTY}' Fail
168 ... msg=Did not run out of dump space as expected.
169
Steven Sombara011c022019-01-16 18:13:52 -0600170
Sivas SRRc0957412017-10-06 13:02:08 -0500171Post Dump BMC Performance Test
172 [Documentation] Check performance of memory, CPU & file system of BMC.
173 [Tags] Post_Dump_BMC_Performance_Test
174
175 Open Connection And Log In
176 Check BMC Performance
177
Steven Sombara011c022019-01-16 18:13:52 -0600178
Sivas SRRc0957412017-10-06 13:02:08 -0500179Post Dump Core Dump Check
180 [Documentation] Check core dump existence on BMC after code update.
181 [Tags] Post_Dump_Core_Dump_Check
182
183 Check For Core Dumps
Rahul Maheshwari0dafbb42017-08-22 13:17:52 -0500184
Rahul Maheshwari1612ac92017-08-30 14:42:32 -0500185
Anusha Dathatrieda09492019-02-26 08:30:13 -0600186Verify Dump After Host Watchdog Error Injection
187 [Documentation] Inject host watchdog error and verify whether dump is generated.
188 [Tags] Verify_Dump_After_Host_Watchdog_Error_Injection
189
George Keishingfb3f9a52019-07-18 13:13:58 -0500190 Redfish Power On
Anusha Dathatrieda09492019-02-26 08:30:13 -0600191
192 Run Keyword And Ignore Error Delete All Dumps
193
194 # Enable auto reboot
195 Set Auto Reboot ${1}
196
197 Trigger Host Watchdog Error 2000 30
198
199 Wait Until Keyword Succeeds 300 sec 20 sec Is Host Rebooted
200
201 #Get dump details
202 @{dump_entry_list}= Read Properties ${DUMP_ENTRY_URI}
203
204 # Verifing that there is only one dump
205 ${length}= Get length ${dump_entry_list}
206 Should Be Equal As Integers ${length} ${1}
207
208 # Get dump id
209 ${value}= Get From List ${dump_entry_list} 0
210 @{split_value}= Split String ${value} /
211 ${dump_id}= Get From List ${split_value} -1
212
213 # Max size for dump is 200k = 200x1024
214 ${dump_size}= Read Attribute ${DUMP_ENTRY_URI}${dump_id} Size
215 Should Be True 0 < ${dump_size} < 204800
216
217
Naman Navin Hegdeebd4d682019-07-22 02:39:35 -0500218Verify Download BMC Dump
219 [Documentation] Verify that a BMC dump can be downloaded to the local machine.
220 [Tags] Verify_Download_BMC_Dump
221
222 ${dump_id}= Create User Initiated Dump
223 ${dump_dict}= Get Dump Dict
224 ${bmc_dump_name}= Fetch From Right ${dump_dict['${dump_id}']} /
225 ${bmc_dump_checksum} ${stderr} ${rc}= BMC Execute Command
226 ... md5sum ${dump_dict['${dump_id}']}|awk '{print$1}'
227 ${bmc_dump_size} ${stderr} ${rc}= BMC Execute Command
228 ... stat -c "%s" ${dump_dict['${dump_id}']}
229
230 ${response}= OpenBMC Get Request ${DUMP_DOWNLOAD_URI}${dump_id}
231 ... quiet=${1}
232 Should Be Equal As Strings ${response.status_code} ${HTTP_OK}
233 Create Binary File ${EXECDIR}${/}dumps ${response.content}
234 Run tar -xvf ${EXECDIR}${/}dumps
235 ${download_dump_name}= Fetch From Left ${bmc_dump_name} .
236 ${download_dump_checksum}= Run md5sum ${EXECDIR}/dumps|awk '{print$1}'
237 ${download_dump_size}= Run stat -c "%s" ${EXECDIR}${/}dumps
238
239 OperatingSystem.Directory Should Exist ${EXECDIR}/${download_dump_name}
240 ... msg=Created dump name and downloaded dump name don't match.
241 Should Be Equal As Strings ${bmc_dump_checksum} ${download_dump_checksum}
242 Should Be Equal As Strings ${bmc_dump_size} ${download_dump_size}
243
244 Run rm -rf ${EXECDIR}${/}${download_dump_name};rm ${EXECDIR}${/}dumps
245
246
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500247*** Keywords ***
248
George Keishing40b7ee02017-11-13 05:12:41 -0600249Test Teardown Execution
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500250 [Documentation] Do the post test teardown.
251
Rahul Maheshwari953038b2017-10-17 05:08:59 -0500252 Wait Until Keyword Succeeds 3 min 15 sec Verify No Dump In Progress
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500253 FFDC On Test Case Fail
Rahul Maheshwaribf9024f2017-10-25 10:51:39 -0500254 Delete All BMC Dump
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500255 Close All Connections