blob: cb203f1e5ba96675d139e765ec8fbf389b57d7c8 [file] [log] [blame]
Rahul Maheshwariad676bf2017-06-22 15:06:05 -05001*** Settings ***
2Documentation This module provides general keywords for dump.
3
Rahul Maheshwari1612ac92017-08-30 14:42:32 -05004Library bmc_ssh_utils.py
Rahul Maheshwariad676bf2017-06-22 15:06:05 -05005
6*** Variables ***
7
8*** Keywords ***
9
10Create User Initiated Dump
11 [Documentation] Generate user initiated dump and return
Steven Sombara011c022019-01-16 18:13:52 -060012 ... the dump id number (e.g., "5"). Optionally return EMPTY
13 ... if out of dump space.
14 [Arguments] ${check_out_of_space}=${False}
15
16 # Description of Argument(s):
17 # check_out_of_space If ${False}, a dump will be created and
18 # its dump_id will be returned.
19 # If ${True}, either the dump_id will be
20 # returned, or the value ${EMPTY} will be
21 # returned if out of dump space was
22 # detected when creating the dump.
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050023
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -050024 ${resp}= OpenBMC Get Request ${DUMP_URI}
25 Run Keyword If '${resp.status_code}' == '${HTTP_NOT_FOUND}'
George Keishing73d8f242021-03-19 08:51:56 -050026 ... Set Global Variable ${DUMP_URI} /xyz/openbmc_project/dump/
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -050027
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050028 ${data}= Create Dictionary data=@{EMPTY}
29 ${resp}= OpenBMC Post Request
Steven Sombara011c022019-01-16 18:13:52 -060030 ... ${DUMP_URI}action/CreateDump data=${data} quiet=${1}
31
32 Run Keyword If '${check_out_of_space}' == '${False}'
George Keishing656eb4a2019-09-03 03:48:01 -050033 ... Run Keyword And Return Get The Dump Id ${resp}
34 ... ELSE
35 ... Run Keyword And Return Check For Too Many Dumps ${resp}
Steven Sombara011c022019-01-16 18:13:52 -060036
37
38Get The Dump Id
39 [Documentation] Wait for the dump to be created. Return the
40 ... dump id number (e.g., "5").
41 [Arguments] ${resp}
42
43 # Description of Argument(s):
44 # resp Response object from action/Create Dump attempt.
45 # Example object:
46 # {
47 # "data": 5,
48 # "message": "200 OK",
49 # "status": "ok"
50 # },
51 # The "data" field conveys the id number of the created dump.
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050052
53 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
54 ${json}= To JSON ${resp.content}
George Keishing73c4ebf2017-11-13 07:10:28 -060055
George Keishing73c4ebf2017-11-13 07:10:28 -060056 Run Keyword If ${json["data"]} == ${None}
57 ... Fail Dump id returned null.
58
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050059 ${dump_id}= Set Variable ${json["data"]}
60
Rahul Maheshwarie2cd17f2017-09-26 21:26:50 -050061 Wait Until Keyword Succeeds 3 min 15 sec Check Dump Existence
Rahul Maheshwariad676bf2017-06-22 15:06:05 -050062 ... ${dump_id}
63
64 [Return] ${dump_id}
65
66
Steven Sombara011c022019-01-16 18:13:52 -060067Check For Too Many Dumps
68 [Documentation] Return the dump_id number, or return ${EMPTY} if dump
69 ... creation failed due to too many dumps.
70 [Arguments] ${resp}
71
72 # Description of Argument(s):
73 # resp Response object from action/Create Dump attempt.
74 # Example object if there are too many dumps:
George Keishing506756e2019-08-06 01:07:55 -050075 # {
Steven Sombara011c022019-01-16 18:13:52 -060076 # "data": {
George Keishing506756e2019-08-06 01:07:55 -050077 # "description": "xyz.openbmc_project.Dump.Create.Error.QuotaExceeded"
78 # },
79 # "message": "Dump not captured due to a cap.",
Steven Sombara011c022019-01-16 18:13:52 -060080 # "status": "error"
George Keishing506756e2019-08-06 01:07:55 -050081 # }
Steven Sombara011c022019-01-16 18:13:52 -060082
83 # If dump was created normally, return the dump_id number.
84 Run Keyword If '${resp.status_code}' == '${HTTP_OK}'
85 ... Run Keyword And Return Get The Dump Id ${resp}
86
George Keishing506756e2019-08-06 01:07:55 -050087 ${json}= To JSON ${resp.content}
88 ${exception}= Set Variable ${json["message"]}
Steven Sombara011c022019-01-16 18:13:52 -060089 ${at_capacity}= Set Variable Dump not captured due to a cap
90 ${too_many_dumps}= Evaluate $at_capacity in $exception
Michael Walshc108e422019-03-28 12:27:18 -050091 Printn
Steven Sombara011c022019-01-16 18:13:52 -060092 Rprint Vars exception too_many_dumps
93 # If there are too many dumps, return ${EMPTY}, otherwise Fail.
94 ${status}= Run Keyword If ${too_many_dumps} Set Variable ${EMPTY}
95 ... ELSE Fail msg=${exception}.
96
97 [Return] ${status}
98
99
Rahul Maheshwari953038b2017-10-17 05:08:59 -0500100Verify No Dump In Progress
101 [Documentation] Verify no dump in progress.
102
Rahul Maheshwari4cfdc392017-10-25 09:44:47 -0500103 ${dump_progress} ${stderr} ${rc}= BMC Execute Command ls /tmp
104 Should Not Contain ${dump_progress} obmcdump
Rahul Maheshwari953038b2017-10-17 05:08:59 -0500105
106
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500107Check Dump Existence
108 [Documentation] Verify if given dump exist.
109 [Arguments] ${dump_id}
110
111 # Description of Argument(s):
112 # dump_id An integer value that identifies a particular dump
113 # object(e.g. 1, 3, 5).
114
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500115 ${resp}= OpenBMC Get Request ${DUMP_URI}
116 Run Keyword If '${resp.status_code}' == '${HTTP_NOT_FOUND}'
George Keishing73d8f242021-03-19 08:51:56 -0500117 ... Set Global Variable ${DUMP_ENTRY_URI} /xyz/openbmc_project/dump/entry/
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500118
George Keishing8d693382018-12-18 12:15:04 -0600119 ${resp}= OpenBMC Get Request ${DUMP_ENTRY_URI}${dump_id}
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500120 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
121
122
123Delete BMC Dump
124 [Documentation] Deletes a given bmc dump.
125 [Arguments] ${dump_id}
126
127 # Description of Argument(s):
Gunnar Mills28e403b2017-10-25 16:16:38 -0500128 # dump_id An integer value that identifies a particular dump (e.g. 1, 3).
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500129
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500130 ${resp}= OpenBMC Get Request ${DUMP_URI}
131 Run Keyword If '${resp.status_code}' == '${HTTP_NOT_FOUND}'
George Keishing73d8f242021-03-19 08:51:56 -0500132 ... Set Global Variable ${DUMP_ENTRY_URI} /xyz/openbmc_project/dump/entry/
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500133
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500134 ${data}= Create Dictionary data=@{EMPTY}
135 ${resp}= OpenBMC Post Request
George Keishing8d693382018-12-18 12:15:04 -0600136 ... ${DUMP_ENTRY_URI}${dump_id}/action/Delete data=${data}
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500137
138 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
139
140Delete All Dumps
141 [Documentation] Delete all dumps.
142
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500143 ${resp}= OpenBMC Get Request ${DUMP_URI}
144 Run Keyword If '${resp.status_code}' == '${HTTP_NOT_FOUND}'
George Keishing73d8f242021-03-19 08:51:56 -0500145 ... Set Global Variable ${DUMP_ENTRY_URI} /xyz/openbmc_project/dump/entry/
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500146
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500147 # Check if dump entries exist, if not return.
George Keishing6a6e76d2017-09-14 08:19:17 -0500148 ${resp}= OpenBMC Get Request ${DUMP_ENTRY_URI}list quiet=${1}
Rahul Maheshwariad676bf2017-06-22 15:06:05 -0500149 Return From Keyword If ${resp.status_code} == ${HTTP_NOT_FOUND}
150
151 # Get the list of dump entries and delete them all.
152 ${dump_entries}= Get URL List ${DUMP_ENTRY_URI}
Marissa Garza20ccfc72020-06-19 12:51:10 -0500153 FOR ${entry} IN @{dump_entries}
154 ${dump_id}= Fetch From Right ${entry} /
155 Delete BMC Dump ${dump_id}
156 END
George Keishingc9fcd092017-09-20 09:24:37 -0500157
Rahul Maheshwaride5d6f12020-10-14 02:08:00 -0500158
Rahul Maheshwari95cbceb2020-10-21 23:25:08 -0500159Redfish Delete BMC Dump
160 [Documentation] Deletes a given BMC dump via Redfish..
161 [Arguments] ${dump_id}
162
163 # Description of Argument(s):
164 # dump_id An integer value that identifies a particular dump (e.g. 1, 3).
165
166 Redfish.Delete /redfish/v1/Managers/bmc/LogServices/Dump/Entries/${dump_id}
167
168
Rahul Maheshwaride5d6f12020-10-14 02:08:00 -0500169Redfish Delete All BMC Dumps
170 [Documentation] Delete all BMC dumps via Redfish.
171
172 # Check if dump entries exist, if not return.
173 ${resp}= Redfish.Get /redfish/v1/Managers/bmc/LogServices/Dump/Entries
174 Return From Keyword If ${resp.dict["Members@odata.count"]} == ${0}
175
176 Redfish.Post /redfish/v1/Managers/bmc/LogServices/Dump/Actions/LogService.ClearLog
177
178
George Keishingc9fcd092017-09-20 09:24:37 -0500179Delete All BMC Dump
180 [Documentation] Delete all BMC dump entries using "DeleteAll" interface.
181
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500182 ${resp}= OpenBMC Get Request ${DUMP_URI}
183 Run Keyword If '${resp.status_code}' == '${HTTP_NOT_FOUND}'
George Keishing73d8f242021-03-19 08:51:56 -0500184 ... Set Global Variable ${DUMP_URI} /xyz/openbmc_project/dump/
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500185
George Keishingc9fcd092017-09-20 09:24:37 -0500186 ${data}= Create Dictionary data=@{EMPTY}
187 ${resp}= Openbmc Post Request ${DUMP_URI}action/DeleteAll data=${data}
188 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
George Keishingdc428762017-11-11 12:37:12 -0600189
George Keishingdc428762017-11-11 12:37:12 -0600190Dump Should Not Exist
191 [Documentation] Verify that BMC dumps do not exist.
192
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500193 ${resp}= OpenBMC Get Request ${DUMP_URI}
194 Run Keyword If '${resp.status_code}' == '${HTTP_NOT_FOUND}'
George Keishing73d8f242021-03-19 08:51:56 -0500195 ... Set Global Variable ${DUMP_ENTRY_URI} /xyz/openbmc_project/dump/entry/
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500196
George Keishing8d693382018-12-18 12:15:04 -0600197 ${resp}= OpenBMC Get Request ${DUMP_ENTRY_URI}list quiet=${1}
George Keishingdc428762017-11-11 12:37:12 -0600198 Should Be Equal As Strings ${resp.status_code} ${HTTP_NOT_FOUND}
199
Steven Sombar336fa972019-11-07 13:12:58 -0600200Check Existence Of BMC Dump File
Sivas SRR7aabd792017-10-18 21:28:23 -0500201 [Documentation] Verify existence of BMC dump file.
202 [Arguments] ${dump_id}
203
204 # Description of argument(s):
205 # dump_id BMC dump identifier
206
207 ${dump_check_cmd}= Set Variable
208 ... ls /var/lib/phosphor-debug-collector/dumps
209
210 # Output of sample BMC Execute command with '2' as dump id is as follows
211 # ls /var/lib/phosphor-debug-collector/dumps/2
212 # obmcdump_2_XXXXXXXXXX.tar.xz
213 ${file_there} ${stderr} ${rc}= BMC Execute Command
214 ... ${dump_check_cmd}/${dump_id}
215 Should End With ${file_there} tar.xz msg=BMC dump file not found.
Rahul Maheshwari1612ac92017-08-30 14:42:32 -0500216
217Get Dump Entries
218 [Documentation] Return dump entries list.
219
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500220 ${resp}= OpenBMC Get Request ${DUMP_URI}
221 Run Keyword If '${resp.status_code}' == '${HTTP_NOT_FOUND}'
George Keishing73d8f242021-03-19 08:51:56 -0500222 ... Set Global Variable ${DUMP_ENTRY_URI} /xyz/openbmc_project/dump/entry/
Rahul Maheshwaria89ff9e2020-09-25 05:04:33 -0500223
Rahul Maheshwari1612ac92017-08-30 14:42:32 -0500224 ${dump_entries}= Get URL List ${DUMP_ENTRY_URI}
225 [Return] ${dump_entries}
226
Rahul Maheshwari1612ac92017-08-30 14:42:32 -0500227Trigger Core Dump
228 [Documentation] Trigger core dump.
229
230 # Find the pid of the active ipmid and kill it.
George Keishingbfd5c8f2018-07-11 10:27:28 -0500231 ${cmd_buf}= Catenate kill -s SEGV $(ps | egrep ' ipmid$' |
Rahul Maheshwari1612ac92017-08-30 14:42:32 -0500232 ... egrep -v grep | \ cut -c1-6)
233
234 ${cmd_output} ${stderr} ${rc}= BMC Execute Command ${cmd_buf}
235 Should Be Empty ${stderr} msg=BMC execute command error.
236 Should Be Equal As Integers ${rc} ${0}
237 ... msg=BMC execute command return code is not zero.
Anusha Dathatrifd350222021-04-08 06:07:49 -0500238
239Create User Initiated BMC Dump Using Redfish
240 [Documentation] Trigger user initiated BMC dump via Redfish and return task id.
241
242 ${payload}= Create Dictionary DiagnosticDataType=Manager
243 ${resp}= Redfish.Post
244 ... /redfish/v1/Managers/bmc/LogServices/Dump/Actions/LogService.CollectDiagnosticData
245 ... body=${payload} valid_status_codes=[${HTTP_ACCEPTED}, ${HTTP_OK}]
246
247 # Example of response from above Redfish POST request.
248 # "@odata.id": "/redfish/v1/TaskService/Tasks/0",
249 # "@odata.type": "#Task.v1_4_3.Task",
250 # "Id": "0",
251 # "TaskState": "Running",
252 # "TaskStatus": "OK"
253
254 ${task_id}= Set Variable ${resp.dict['Id']}
255 [Return] ${task_id}
256
257Auto Generate BMC Dump
258 [Documentation] Auto generate BMC dump.
259
260 ${stdout} ${stderr} ${rc}=
261 ... BMC Execute Command
George Keishing6ecc04b2021-06-04 04:15:06 -0500262 ... busctl --verbose call xyz.openbmc_project.Dump.Manager
263 ... /xyz/openbmc_project/dump/bmc xyz.openbmc_project.Dump.Create CreateDump a{ss} 0
Anusha Dathatrifd350222021-04-08 06:07:49 -0500264 [Return] ${stdout} ${stderr} ${rc}
265
266Get Dump Size
267 [Documentation] Get dump size.
Anusha Dathatrieed0e592021-04-21 03:17:12 -0500268 [Arguments] ${dump_uri}
Anusha Dathatrifd350222021-04-08 06:07:49 -0500269
270 # Description of argument(s):
Anusha Dathatrieed0e592021-04-21 03:17:12 -0500271 # dump_uri Dump URI
272 # (Eg. /xyz/openbmc_project/dump/bmc/entry/1).
Anusha Dathatrifd350222021-04-08 06:07:49 -0500273
Anusha Dathatrieed0e592021-04-21 03:17:12 -0500274 # Example of Dump entry.
275 # "data": {
276 # "CompletedTime": 1616760931,
277 # "Elapsed": 1616760931,
278 # "OffloadUri": "",
279 # "Offloaded": false,
280 # "Password": "",
281 # "Size": 3056,
282 # "SourceDumpId": 117440513,
283 # "StartTime": 1616760931,
284 # "Status": "xyz.openbmc_project.Common.Progress.OperationStatus.Completed",
285 # "VSPString": ""
286 # },
Anusha Dathatrifd350222021-04-08 06:07:49 -0500287
Anusha Dathatrieed0e592021-04-21 03:17:12 -0500288 Log ${dump_uri}
289 ${dump_data}= Redfish.Get Properties ${dump_uri}
290 [Return] ${dump_data["data"]["Size"]}
Anusha Dathatrifd350222021-04-08 06:07:49 -0500291
292Get Dump ID
Anusha Dathatrieed0e592021-04-21 03:17:12 -0500293 [Documentation] Return dump ID.
Anusha Dathatrifd350222021-04-08 06:07:49 -0500294 [Arguments] ${task_id}
295
296 # Description of argument(s):
297 # task_id Task ID.
298
299 # Example of HttpHeaders field of task details.
300 # "Payload": {
301 # "HttpHeaders": [
302 # "Host: <BMC_IP>",
303 # "Accept-Encoding: identity",
304 # "Connection: Keep-Alive",
305 # "Accept: */*",
306 # "Content-Length: 33",
307 # "Location: /redfish/v1/Managers/bmc/LogServices/Dump/Entries/2"]
308 # ],
309 # "HttpOperation": "POST",
310 # "JsonBody": "{\"DiagnosticDataType\":\"Manager\"}",
311 # "TargetUri":
312 # "/redfish/v1/Managers/bmc/LogServices/Dump/Actions/LogService.CollectDiagnosticData"
313 # }
314
315 ${task_dict}= Redfish.Get Properties /redfish/v1/TaskService/Tasks/${task_id}
316 ${key} ${value}= Set Variable ${task_dict["Payload"]["HttpHeaders"][-1].split(":")}
317 Run Keyword If '${key}' != 'Location' Fail
318 [Return] ${value.split('/')[-1]}
319
320Get Task Status
321 [Documentation] Return task status.
322 [Arguments] ${task_id}
323
324 # Description of argument(s):
325 # task_id Task ID.
326
327 ${resp}= Redfish.Get Properties /redfish/v1/TaskService/Tasks/${task_id}
328 [Return] ${resp['TaskState']}
329
Anusha Dathatrieed0e592021-04-21 03:17:12 -0500330Check Task Completion
331 [Documentation] Check if the task is complete.
332 [Arguments] ${task_id}
333
334 # Description of argument(s):
335 # task_id Task ID.
336
337 ${status}= Get Task Status ${task_id}
338 Run Keyword Unless '${status}' == 'Cancelled' or '${status}' == 'Completed'
339 ... Fail Task is still running.
340 [Return] ${status}
341
Anusha Dathatrifd350222021-04-08 06:07:49 -0500342Get Dump ID And Status
343 [Documentation] Return dump ID and status.
344 [Arguments] ${task_id}
345
346 # Description of argument(s):
347 # task_id Task ID.
348
Anusha Dathatrieed0e592021-04-21 03:17:12 -0500349 ${task_status}= Wait Until Keyword Succeeds 10 min 15 sec Check Task Completion ${task_id}
350 ${dump_id}= Run Keyword If '${task_status}' == 'Completed' Get Dump ID ${task_id}
351 ... ELSE Set Variable None
352 [Return] ${dump_id} ${task_status}