blob: 58a73e84d82af18b6fa05ba9406d8ed0dd1113b2 [file] [log] [blame]
Chris Austenb29d2e82016-06-07 12:25:35 -05001*** Settings ***
2Resource ../lib/resource.txt
3Resource ../lib/rest_client.robot
George Keishing5e870cd2016-08-24 10:05:47 -05004Resource ../lib/connection_client.robot
Michael Walsh391ba9b2017-08-24 11:36:24 -05005Library String
George Keishing30c12ff2016-09-02 10:25:29 -05006Library DateTime
7Library Process
Chris Austenb29d2e82016-06-07 12:25:35 -05008Library OperatingSystem
Michael Walsha6723f22016-11-22 11:12:01 -06009Library gen_print.py
10Library gen_robot_print.py
Michael Walsh5f3f4142017-05-22 17:09:47 -050011Library gen_cmd.py
Sunil Macd110a2017-05-23 04:14:32 -050012Library gen_robot_keyword.py
Michael Walshe53e47a2017-06-30 17:03:24 -050013Library bmc_ssh_utils.py
Michael Walshfdc5ced2017-08-17 13:15:15 -050014Library utils.py
Charles Paul Hofer35816152017-10-02 11:55:11 -050015Library var_funcs.py
Sridevi Ramesh0d88ab32017-09-21 11:07:28 -050016Library SCPLibrary WITH NAME scp
Chris Austenb29d2e82016-06-07 12:25:35 -050017
18*** Variables ***
Sivas SRRd97aa9c2017-05-22 11:19:25 -050019${pflash_cmd} /usr/sbin/pflash -r /dev/stdout -P VERSION
Chris Austenb29d2e82016-06-07 12:25:35 -050020${SYSTEM_SHUTDOWN_TIME} ${5}
Michael Walsha6723f22016-11-22 11:12:01 -060021${dbuscmdBase}
George Keishing85ca05e2016-11-30 09:47:18 -060022... dbus-send --system --print-reply --dest=${OPENBMC_BASE_DBUS}.settings.Host
Michael Walsha6723f22016-11-22 11:12:01 -060023${dbuscmdGet}
George Keishing9485af92017-01-04 10:21:43 -060024... ${SETTINGS_URI}host0 org.freedesktop.DBus.Properties.Get
George Keishing85ca05e2016-11-30 09:47:18 -060025# Enable when ready with openbmc/openbmc-test-automation#203
26#${dbuscmdString}= string:"xyz.openbmc_project.settings.Host" string:
Michael Walsha6723f22016-11-22 11:12:01 -060027${dbuscmdString}= string:"org.openbmc.settings.Host" string:
28
29# Assign default value to QUIET for programs which may not define it.
30${QUIET} ${0}
Sivas SRRea85d1f2016-11-13 22:44:28 -060031${bmc_mem_free_cmd}= free | tr -s ' ' | sed '/^Mem/!d' | cut -d" " -f4
32${bmc_mem_total_cmd}= free | tr -s ' ' | sed '/^Mem/!d' | cut -d" " -f2
33${bmc_cpu_usage_cmd}= top -n 1 | grep CPU: | cut -c 7-9
Sridevi Ramesh1699d372016-12-06 00:20:22 -060034${HOST_SETTING} ${SETTINGS_URI}host0
Sivas SRR352bc162017-02-13 22:12:29 -060035# /run/initramfs/ro associate filesystem should be 100% full always
Sivas SRRaca55712016-12-21 04:32:35 -060036${bmc_file_system_usage_cmd}=
Sivas SRR352bc162017-02-13 22:12:29 -060037... df -h | grep -v /run/initramfs/ro | cut -c 52-54 | grep 100 | wc -l
Chris Austenb29d2e82016-06-07 12:25:35 -050038
George Keishingcce9df22017-01-24 06:19:33 -060039${BOOT_TIME} ${0}
40${BOOT_COUNT} ${0}
Sweta Potthuri025e0122017-02-21 00:42:48 -060041${count} ${0}
Sivas SRR8254db62017-02-07 09:39:46 -060042${devicetree_base} /sys/firmware/devicetree/base/model
George Keishingcce9df22017-01-24 06:19:33 -060043
George Keishingb7c9b542017-05-23 08:19:58 -050044# Initialize default debug value to 0.
45${DEBUG} ${0}
46
Michael Walshfdc5ced2017-08-17 13:15:15 -050047# These variables are used to straddle between new and old methods of setting
48# values.
Michael Walshc972d4d2017-08-16 15:38:03 -050049${boot_prog_method} ${EMPTY}
50
Michael Walshfdc5ced2017-08-17 13:15:15 -050051${power_policy_setup} ${0}
52${bmc_power_policy_method} ${EMPTY}
53@{valid_power_policy_vars} RESTORE_LAST_STATE ALWAYS_POWER_ON
54... ALWAYS_POWER_OFF
55
Sridevi Ramesh0d88ab32017-09-21 11:07:28 -050056${probe_cpu_tool_path} ${EXECDIR}/tools/ras/probe_cpus.sh
57${scom_addrs_tool_path} ${EXECDIR}/tools/ras/scom_addr_p9.sh
58${target_file_path} /root/
59
Chris Austenb29d2e82016-06-07 12:25:35 -050060*** Keywords ***
Sridevi Ramesh1699d372016-12-06 00:20:22 -060061
Sivas SRRc0957412017-10-06 13:02:08 -050062Check BMC Performance
63 [Documentation] Check BMC basic CPU Mem File system performance.
64
65 Check BMC CPU Performance
66 Check BMC Mem Performance
67 Check BMC File System Performance
68
Sivas SRRd97aa9c2017-05-22 11:19:25 -050069Verify PNOR Update
70 [Documentation] Verify that the PNOR is not corrupted.
71 # Example:
72 # FFS: Flash header not found. Code: 100
73 # Error 100 opening ffs !
74
75 Open Connection And Log In
76 ${pnor_info}= Execute Command On BMC ${pflash_cmd}
77 Should Not Contain Any ${pnor_info} Flash header not found Error
78
Sivas SRR8254db62017-02-07 09:39:46 -060079Get BMC System Model
80 [Documentation] Get the BMC model from the device tree.
81
Michael Walshe53e47a2017-06-30 17:03:24 -050082 ${bmc_model} ${stderr} ${rc}= BMC Execute Command
George Keishing90ab1772017-02-24 05:40:55 -060083 ... cat ${devicetree_base} | cut -d " " -f 1 return_stderr=True
Michael Walsh71182ab2017-10-20 14:44:25 -050084 ... test_mode=0
Sivas SRR8254db62017-02-07 09:39:46 -060085 Should Be Empty ${stderr}
86 Should Not Be Empty ${bmc_model}
87 [Return] ${bmc_model}
88
89Verify BMC System Model
90 [Documentation] Verify the BMC model with ${OPENBMC_MODEL}.
91 [Arguments] ${bmc_model}
92
93 ${tmp_bmc_model}= Fetch From Right ${OPENBMC_MODEL} /
94 ${tmp_bmc_model}= Fetch From Left ${tmp_bmc_model} .
95 ${ret}= Run Keyword And Return Status Should Contain ${bmc_model}
96 ... ${tmp_bmc_model} ignore_case=True
97 [Return] ${ret}
98
Chris Austenb29d2e82016-06-07 12:25:35 -050099Wait For Host To Ping
root442f0ef2016-08-04 20:23:05 +0000100 [Arguments] ${host} ${timeout}=${OPENBMC_REBOOT_TIMEOUT}min
101 ... ${interval}=5 sec
102
103 # host The DNS name or IP of the host to ping.
104 # timeout The amount of time after which attempts to ping cease.
105 # interval The amount of time in between attempts to ping.
106
107 Wait Until Keyword Succeeds ${timeout} ${interval} Ping Host ${host}
Chris Austenb29d2e82016-06-07 12:25:35 -0500108
109Ping Host
110 [Arguments] ${host}
George Keishing8a84f952016-08-25 04:54:53 -0500111 Should Not Be Empty ${host} msg=No host provided
Michael Walsha6723f22016-11-22 11:12:01 -0600112 ${RC} ${output}= Run and return RC and Output ping -c 4 ${host}
Chris Austenb29d2e82016-06-07 12:25:35 -0500113 Log RC: ${RC}\nOutput:\n${output}
114 Should be equal ${RC} ${0}
115
116Get Boot Progress
Michael Walshc972d4d2017-08-16 15:38:03 -0500117 [Documentation] Get the boot progress and return it.
Michael Walsha6723f22016-11-22 11:12:01 -0600118 [Arguments] ${quiet}=${QUIET}
119
Michael Walshc972d4d2017-08-16 15:38:03 -0500120 # Description of argument(s):
121 # quiet Indicates whether this keyword should run without any output to
122 # the console.
123
124 Set Boot Progress Method
125 ${state}= Run Keyword If '${boot_prog_method}' == 'New'
126 ... New Get Boot Progress quiet=${quiet}
127 ... ELSE
128 ... Old Get Boot Progress quiet=${quiet}
129
130 [Return] ${state}
131
132Set Boot Progress Method
133 [Documentation] Set the boot_prog_method to either 'Old' or 'New'.
134
135 # The boot progress data has moved from an 'org' location to an 'xyz'
136 # location. This keyword will determine whether the new method of getting
137 # the boot progress is valid and will set the global boot_prog_method
138 # variable accordingly. If boot_prog_method is already set (either by a
139 # prior call to this function or via a -v parm), this keyword will simply
140 # return.
141
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500142 # Note: There are interim builds that contain boot_progress in both the
143 # old and the new location values. It is nearly impossible for this
144 # keyword to determine whether the old boot_progress or the new one is
145 # active. When using such builds where the old boot_progress is active,
146 # the only recourse users will have is that they may specify
147 # -v boot_prog_method:Old to force old behavior on such builds.
Michael Walshc972d4d2017-08-16 15:38:03 -0500148
149 Run Keyword If '${boot_prog_method}' != '${EMPTY}' Return From Keyword
150
151 ${new_status} ${new_value}= Run Keyword And Ignore Error
152 ... New Get Boot Progress
153 # If the new style read fails, the method must necessarily be "Old".
154 Run Keyword If '${new_status}' == 'PASS'
155 ... Run Keywords
156 ... Set Global Variable ${boot_prog_method} New AND
157 ... Rqpvars boot_prog_method AND
158 ... Return From Keyword
159
160 # Default method is "Old".
161 Set Global Variable ${boot_prog_method} Old
162 Rqpvars boot_prog_method
163
164Old Get Boot Progress
165 [Documentation] Get the boot progress the old way (via org location).
166 [Arguments] ${quiet}=${QUIET}
167
168 # Description of argument(s):
169 # quiet Indicates whether this keyword should run without any output to
170 # the console.
171
George Keishing85ca05e2016-11-30 09:47:18 -0600172 ${state}= Read Attribute ${OPENBMC_BASE_URI}sensors/host/BootProgress
Michael Walsha6723f22016-11-22 11:12:01 -0600173 ... value quiet=${quiet}
Michael Walshc972d4d2017-08-16 15:38:03 -0500174
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600175 [Return] ${state}
Chris Austenb29d2e82016-06-07 12:25:35 -0500176
Michael Walshc972d4d2017-08-16 15:38:03 -0500177New Get Boot Progress
178 [Documentation] Get the boot progress the new way (via xyz location).
179 [Arguments] ${quiet}=${QUIET}
180
181 # Description of argument(s):
182 # quiet Indicates whether this keyword should run without any output to
183 # the console.
184
185 ${state}= Read Attribute ${HOST_STATE_URI} BootProgress quiet=${quiet}
186
187 [Return] ${state.rsplit('.', 1)[1]}
188
Chris Austenb29d2e82016-06-07 12:25:35 -0500189Is Power On
root442f0ef2016-08-04 20:23:05 +0000190 ${state}= Get Power State
191 Should be equal ${state} ${1}
Chris Austenb29d2e82016-06-07 12:25:35 -0500192
193Is Power Off
root442f0ef2016-08-04 20:23:05 +0000194 ${state}= Get Power State
195 Should be equal ${state} ${0}
Chris Austenb29d2e82016-06-07 12:25:35 -0500196
root442f0ef2016-08-04 20:23:05 +0000197Initiate Power On
198 [Documentation] Initiates the power on and waits until the Is Power On
199 ... keyword returns that the power state has switched to on.
Michael Walsha6723f22016-11-22 11:12:01 -0600200 [Arguments] ${wait}=${1}
201
Chris Austenb29d2e82016-06-07 12:25:35 -0500202 @{arglist}= Create List
203 ${args}= Create Dictionary data=@{arglist}
George Keishing85ca05e2016-11-30 09:47:18 -0600204 ${resp}= Call Method ${OPENBMC_BASE_URI}control/chassis0/ powerOn
Michael Walsha6723f22016-11-22 11:12:01 -0600205 ... data=${args}
Chris Austenb29d2e82016-06-07 12:25:35 -0500206 should be equal as strings ${resp.status_code} ${HTTP_OK}
Chris Austenb29d2e82016-06-07 12:25:35 -0500207
Michael Walsha6723f22016-11-22 11:12:01 -0600208 # Does caller want to wait for power on status?
209 Run Keyword If '${wait}' == '${0}' Return From Keyword
210 Wait Until Keyword Succeeds 3 min 10 sec Is Power On
Rahul Maheshwarif684ba72016-10-25 07:24:41 -0500211
root442f0ef2016-08-04 20:23:05 +0000212Initiate Power Off
213 [Documentation] Initiates the power off and waits until the Is Power Off
214 ... keyword returns that the power state has switched to off.
Chris Austenb29d2e82016-06-07 12:25:35 -0500215 @{arglist}= Create List
216 ${args}= Create Dictionary data=@{arglist}
George Keishing85ca05e2016-11-30 09:47:18 -0600217 ${resp}= Call Method ${OPENBMC_BASE_URI}control/chassis0/ powerOff
Michael Walsha6723f22016-11-22 11:12:01 -0600218 ... data=${args}
Chris Austenb29d2e82016-06-07 12:25:35 -0500219 should be equal as strings ${resp.status_code} ${HTTP_OK}
Michael Walsha6723f22016-11-22 11:12:01 -0600220 Wait Until Keyword Succeeds 1 min 10 sec Is Power Off
Chris Austenb29d2e82016-06-07 12:25:35 -0500221
Michael Walsh81843772017-03-02 14:44:44 -0600222Initiate OS Host Power Off
223 [Documentation] Initiate an OS reboot.
224 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
225 ... ${os_password}=${OS_PASSWORD}
226
227 # Description of arguments:
228 # os_host The DNS name or IP of the OS.
229 # os_username The username to be used to sign in to the OS.
230 # os_password The password to be used to sign in to the OS.
231
Michael Walsh4549cd12017-09-07 18:02:36 -0500232 ${cmd_buf}= Run Keyword If '${os_username}' == 'root'
233 ... Set Variable shutdown
234 ... ELSE
235 ... Set Variable echo ${os_password} | sudo -S shutdown
236
237 ${output} ${stderr} ${rc}= OS Execute Command
238 ... ${cmd_buf} fork=${1}
Michael Walsh81843772017-03-02 14:44:44 -0600239
240Initiate OS Host Reboot
241 [Documentation] Initiate an OS reboot.
242 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
243 ... ${os_password}=${OS_PASSWORD}
244
Michael Walshf1a59fb2017-09-01 17:07:13 -0500245 # Description of argument(s):
246 # os_host The host name or IP address of the OS.
Michael Walsh81843772017-03-02 14:44:44 -0600247 # os_username The username to be used to sign in to the OS.
248 # os_password The password to be used to sign in to the OS.
249
Michael Walshf1a59fb2017-09-01 17:07:13 -0500250 ${cmd_buf}= Run Keyword If '${os_username}' == 'root'
251 ... Set Variable reboot
252 ... ELSE
253 ... Set Variable echo ${os_password} | sudo -S reboot
254
255 ${output} ${stderr} ${rc}= OS Execute Command
256 ... ${cmd_buf} fork=${1}
Michael Walsh81843772017-03-02 14:44:44 -0600257
258Initiate Auto Reboot
259 [Documentation] Initiate an auto reboot.
260
261 # Set the auto reboot policy.
Sweta Potthuri62a23572017-07-28 04:05:13 -0500262 Set Auto Reboot ${1}
Michael Walsh81843772017-03-02 14:44:44 -0600263 # Set the watchdog timer. Note: 5000 = milliseconds which is 5 seconds.
George Keishing37cfa6b2017-06-15 10:25:55 -0500264 Trigger Host Watchdog Error 5000
Michael Walsh81843772017-03-02 14:44:44 -0600265
Chris Austenb29d2e82016-06-07 12:25:35 -0500266Trigger Warm Reset
267 log to console "Triggering warm reset"
Michael Walsha6723f22016-11-22 11:12:01 -0600268 ${data}= create dictionary data=@{EMPTY}
George Keishing85ca05e2016-11-30 09:47:18 -0600269 ${resp}= openbmc post request
270 ... ${OPENBMC_BASE_URI}control/bmc0/action/warmReset data=${data}
Chris Austenb29d2e82016-06-07 12:25:35 -0500271 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
George Keishingb3700812016-08-31 03:03:30 -0500272 ${session_active}= Check If warmReset is Initiated
273 Run Keyword If '${session_active}' == '${True}'
274 ... Fail msg=warm reset didn't occur
275
Chris Austenb29d2e82016-06-07 12:25:35 -0500276 Sleep ${SYSTEM_SHUTDOWN_TIME}min
Rahul Maheshwari5f253c42017-01-30 05:19:51 -0600277 Check If BMC Is Up
Michael Walsh49ab0f42016-07-20 11:44:33 -0500278
279Check OS
root442f0ef2016-08-04 20:23:05 +0000280 [Documentation] Attempts to ping the host OS and then checks that the host
281 ... OS is up by running an SSH command.
Michael Walsh49ab0f42016-07-20 11:44:33 -0500282
283 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
Michael Walsha6723f22016-11-22 11:12:01 -0600284 ... ${os_password}=${OS_PASSWORD} ${quiet}=${QUIET}
285 ... ${print_string}=${EMPTY}
Michael Walshac275512017-03-07 11:39:28 -0600286 [Teardown] SSHLibrary.Close Connection
Michael Walsh49ab0f42016-07-20 11:44:33 -0500287
288 # os_host The DNS name/IP of the OS host associated with our BMC.
289 # os_username The username to be used to sign on to the OS host.
290 # os_password The password to be used to sign on to the OS host.
Michael Walsha6723f22016-11-22 11:12:01 -0600291 # quiet Indicates whether this keyword should write to console.
292 # print_string A string to be printed before checking the OS.
293
294 rprint ${print_string}
Michael Walsh49ab0f42016-07-20 11:44:33 -0500295
root442f0ef2016-08-04 20:23:05 +0000296 # Attempt to ping the OS. Store the return code to check later.
297 ${ping_rc}= Run Keyword and Return Status Ping Host ${os_host}
298
Michael Walshac275512017-03-07 11:39:28 -0600299 SSHLibrary.Open connection ${os_host}
Michael Walsh49ab0f42016-07-20 11:44:33 -0500300
Michael Walsha6723f22016-11-22 11:12:01 -0600301 ${status} ${msg}= Run Keyword And Ignore Error Login ${os_username}
302 ... ${os_password}
303 ${err_msg1}= Sprint Error ${msg}
304 ${err_msg}= Catenate SEPARATOR= \n ${err_msg1}
305 Run Keyword If '${status}' == 'FAIL' Fail msg=${err_msg}
Michael Walsh49ab0f42016-07-20 11:44:33 -0500306 ${output} ${stderr} ${rc}= Execute Command uptime return_stderr=True
307 ... return_rc=True
308
Michael Walsha6723f22016-11-22 11:12:01 -0600309 ${temp_msg}= Catenate Could not execute a command on the operating
310 ... system.\n
311 ${err_msg1}= Sprint Error ${temp_msg}
312 ${err_msg}= Catenate SEPARATOR= \n ${err_msg1}
313
314 # If the return code returned by "Execute Command" is non-zero, this
315 # keyword will fail.
316 Should Be Equal ${rc} ${0} msg=${err_msg}
Michael Walsh49ab0f42016-07-20 11:44:33 -0500317 # We will likewise fail if there is any stderr data.
318 Should Be Empty ${stderr}
319
Michael Walsha6723f22016-11-22 11:12:01 -0600320 ${temp_msg}= Set Variable Could not ping the operating system.\n
321 ${err_msg1}= Sprint Error ${temp_msg}
322 ${err_msg}= Catenate SEPARATOR= \n ${err_msg1}
323 # We will likewise fail if the OS did not ping, as we could SSH but not
324 # ping
325 Should Be Equal As Strings ${ping_rc} ${TRUE} msg=${err_msg}
root442f0ef2016-08-04 20:23:05 +0000326
Michael Walsh49ab0f42016-07-20 11:44:33 -0500327Wait for OS
328 [Documentation] Waits for the host OS to come up via calls to "Check OS".
329 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
330 ... ${os_password}=${OS_PASSWORD} ${timeout}=${OS_WAIT_TIMEOUT}
Michael Walsha6723f22016-11-22 11:12:01 -0600331 ... ${quiet}=${0}
332 [Teardown] rprintn
Michael Walsh49ab0f42016-07-20 11:44:33 -0500333
334 # os_host The DNS name or IP of the OS host associated with our
335 # BMC.
336 # os_username The username to be used to sign on to the OS host.
337 # os_password The password to be used to sign on to the OS host.
338 # timeout The timeout in seconds indicating how long you're
339 # willing to wait for the OS to respond.
Michael Walsha6723f22016-11-22 11:12:01 -0600340 # quiet Indicates whether this keyword should write to console.
Michael Walsh49ab0f42016-07-20 11:44:33 -0500341
342 # The interval to be used between calls to "Check OS".
343 ${interval}= Set Variable 5
344
Michael Walsha6723f22016-11-22 11:12:01 -0600345 ${message}= Catenate Checking every ${interval} seconds for up to
346 ... ${timeout} seconds for the operating system to communicate.
347 rqprint_timen ${message}
348
Michael Walsh49ab0f42016-07-20 11:44:33 -0500349 Wait Until Keyword Succeeds ${timeout} sec ${interval} Check OS
350 ... ${os_host} ${os_username} ${os_password}
Michael Walsha6723f22016-11-22 11:12:01 -0600351 ... print_string=\#
352
353 rqprintn
354
355 rqprint_timen The operating system is now communicating.
root442f0ef2016-08-04 20:23:05 +0000356
root442f0ef2016-08-04 20:23:05 +0000357
358Get Power State
359 [Documentation] Returns the power state as an integer. Either 0 or 1.
Michael Walsha6723f22016-11-22 11:12:01 -0600360 [Arguments] ${quiet}=${QUIET}
361
root442f0ef2016-08-04 20:23:05 +0000362 @{arglist}= Create List
363 ${args}= Create Dictionary data=@{arglist}
Michael Walsha6723f22016-11-22 11:12:01 -0600364
George Keishing85ca05e2016-11-30 09:47:18 -0600365 ${resp}= Call Method ${OPENBMC_BASE_URI}control/chassis0/ getPowerState
Michael Walsha6723f22016-11-22 11:12:01 -0600366 ... data=${args} quiet=${quiet}
root442f0ef2016-08-04 20:23:05 +0000367 Should be equal as strings ${resp.status_code} ${HTTP_OK}
368 ${content}= to json ${resp.content}
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600369 [Return] ${content["data"]}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500370
371Clear BMC Record Log
372 [Documentation] Clears all the event logs on the BMC. This would be
373 ... equivalent to ipmitool sel clear.
374 @{arglist}= Create List
375 ${args}= Create Dictionary data=@{arglist}
George Keishing85ca05e2016-11-30 09:47:18 -0600376 ${resp}= Call Method
377 ... ${OPENBMC_BASE_URI}records/events/ clear data=${args}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500378 should be equal as strings ${resp.status_code} ${HTTP_OK}
379
380Copy PNOR to BMC
381 Import Library SCPLibrary WITH NAME scp
382 Open Connection for SCP
383 Log Copying ${PNOR_IMAGE_PATH} to /tmp
384 scp.Put File ${PNOR_IMAGE_PATH} /tmp
385
386Flash PNOR
387 [Documentation] Calls flash bios update method to flash PNOR image
Gunnar Mills38032802016-12-12 13:43:40 -0600388 [Arguments] ${pnor_image}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500389 @{arglist}= Create List ${pnor_image}
390 ${args}= Create Dictionary data=@{arglist}
George Keishing85ca05e2016-11-30 09:47:18 -0600391 ${resp}= Call Method ${OPENBMC_BASE_URI}control/flash/bios/ update
Michael Walsha6723f22016-11-22 11:12:01 -0600392 ... data=${args}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500393 should be equal as strings ${resp.status_code} ${HTTP_OK}
394 Wait Until Keyword Succeeds 2 min 10 sec Is PNOR Flashing
395
396Get Flash BIOS Status
397 [Documentation] Returns the status of the flash BIOS API as a string. For
398 ... example 'Flashing', 'Flash Done', etc
George Keishing85ca05e2016-11-30 09:47:18 -0600399 ${data}= Read Properties ${OPENBMC_BASE_URI}control/flash/bios
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600400 [Return] ${data['status']}
Jay Azurine4c52eb2016-08-16 20:51:10 -0500401
402Is PNOR Flashing
403 [Documentation] Get BIOS 'Flashing' status. This indicates that PNOR
404 ... flashing has started.
405 ${status}= Get Flash BIOS Status
Rahul Maheshwari449dfb72017-05-08 02:06:48 -0500406 Should Contain ${status} Flashing
Jay Azurine4c52eb2016-08-16 20:51:10 -0500407
408Is PNOR Flash Done
409 [Documentation] Get BIOS 'Flash Done' status. This indicates that the
410 ... PNOR flashing has completed.
Leah McNutt9ba32272016-11-17 15:48:39 +0000411 ${status}= Get Flash BIOS Status
Jay Azurine4c52eb2016-08-16 20:51:10 -0500412 should be equal as strings ${status} Flash Done
413
George Keishing5e870cd2016-08-24 10:05:47 -0500414
Rahul Maheshwari2c725042017-01-29 22:55:28 -0600415Is OS Starting
416 [Documentation] Check if boot progress is OS starting.
417 ${boot_progress}= Get Boot Progress
Michael Walsh01975fa2017-08-20 20:51:36 -0500418 Should Be Equal ${boot_progress} OSStart
Rahul Maheshwari2c725042017-01-29 22:55:28 -0600419
George Keishing0af24412017-03-10 13:33:23 -0600420Is OS Off
421 [Documentation] Check if boot progress is "Off".
422 ${boot_progress}= Get Boot Progress
423 Should Be Equal ${boot_progress} Off
424
Rahul Maheshwariffd30de2017-06-27 05:57:45 -0500425Get Boot Progress To OS Starting State
426 [Documentation] Get the system to a boot progress state of 'FW Progress,
427 ... Starting OS'.
428
429 ${boot_progress}= Get Boot Progress
Michael Walsh01975fa2017-08-20 20:51:36 -0500430 Run Keyword If '${boot_progress}' == 'OSStart'
Rahul Maheshwariffd30de2017-06-27 05:57:45 -0500431 ... Log Host is already in OS starting state
432 ... ELSE
433 ... Run Keywords Initiate Host PowerOff AND Initiate Host Boot
434 ... AND Wait Until Keyword Succeeds 10 min 10 sec Is OS Starting
435
George Keishing5e870cd2016-08-24 10:05:47 -0500436Verify Ping and REST Authentication
Michael Walsha6723f22016-11-22 11:12:01 -0600437 ${l_ping}= Run Keyword And Return Status
George Keishing5e870cd2016-08-24 10:05:47 -0500438 ... Ping Host ${OPENBMC_HOST}
George Keishingc4d3dc02016-09-19 03:45:55 -0500439 Run Keyword If '${l_ping}' == '${False}'
440 ... Fail msg=Ping Failed
George Keishing5e870cd2016-08-24 10:05:47 -0500441
Michael Walsha6723f22016-11-22 11:12:01 -0600442 ${l_rest}= Run Keyword And Return Status
George Keishing5e870cd2016-08-24 10:05:47 -0500443 ... Initialize OpenBMC
George Keishingc4d3dc02016-09-19 03:45:55 -0500444 Run Keyword If '${l_rest}' == '${False}'
445 ... Fail msg=REST Authentication Failed
George Keishing5e870cd2016-08-24 10:05:47 -0500446
447 # Just to make sure the SSH is working for SCP
448 Open Connection And Log In
449 ${system} ${stderr}= Execute Command hostname return_stderr=True
450 Should Be Empty ${stderr}
451
George Keishingc4d3dc02016-09-19 03:45:55 -0500452Check If BMC is Up
453 [Documentation] Wait for Host to be online. Checks every X seconds
454 ... interval for Y minutes and fails if timed out.
455 ... Default MAX timedout is 10 min, interval 10 seconds.
Gunnar Mills38032802016-12-12 13:43:40 -0600456 [Arguments] ${max_timeout}=${OPENBMC_REBOOT_TIMEOUT} min
George Keishingc4d3dc02016-09-19 03:45:55 -0500457 ... ${interval}=10 sec
458
459 Wait Until Keyword Succeeds
460 ... ${max_timeout} ${interval} Verify Ping and REST Authentication
461
George Keishingb3700812016-08-31 03:03:30 -0500462
463Check If warmReset is Initiated
464 [Documentation] Ping would be still alive, so try SSH to connect
465 ... if fails the ports are down indicating reboot
466 ... is in progress
George Keishing3c05d352016-12-13 06:54:50 -0600467
468 # Warm reset adds 3 seconds delay before forcing reboot
469 # To minimize race conditions, we wait for 7 seconds
470 Sleep 7s
George Keishingb3700812016-08-31 03:03:30 -0500471 ${alive}= Run Keyword and Return Status
472 ... Open Connection And Log In
473 Return From Keyword If '${alive}' == '${False}' ${False}
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600474 [Return] ${True}
George Keishingb3700812016-08-31 03:03:30 -0500475
George Keishing06ae4aa2016-08-30 01:41:28 -0500476Flush REST Sessions
477 [Documentation] Removes all the active session objects
478 Delete All Sessions
George Keishingb3700812016-08-31 03:03:30 -0500479
Sivas SRRe1143ae2016-08-26 22:31:02 -0500480Initialize DBUS cmd
481 [Documentation] Initialize dbus string with property string to extract
Gunnar Mills38032802016-12-12 13:43:40 -0600482 [Arguments] ${boot_property}
Michael Walsha6723f22016-11-22 11:12:01 -0600483 ${cmd}= Catenate ${dbuscmdBase} ${dbuscmdGet} ${dbuscmdString}
484 ${cmd}= Catenate ${cmd}${boot_property}
Sivas SRRe1143ae2016-08-26 22:31:02 -0500485 Set Global Variable ${dbuscmd} ${cmd}
486
David Shawba2d2c22017-01-23 16:56:38 -0600487Create OS Console File Path
488 [Documentation] Create OS console file path name and return it.
489 [Arguments] ${log_file_path}=${EMPTY}
George Keishing30c12ff2016-09-02 10:25:29 -0500490
David Shawba2d2c22017-01-23 16:56:38 -0600491 # Description of arguements:
492 # file_path The caller's candidate value. If this value is ${EMPTY}, this
493 # keyword will compose a file path name. Otherwise, this
494 # keyword will use the caller's file_path value. In either
495 # case, the value will be returned.
Gunnar Mills9c760342016-12-08 10:12:06 -0600496
George Keishing3deb7d12017-09-14 07:50:00 -0500497 ${default_file_path}= Catenate /tmp/${OPENBMC_HOST}_os_console.txt
David Shawba2d2c22017-01-23 16:56:38 -0600498 ${log_file_path}= Set Variable If '${log_file_path}' == '${EMPTY}'
499 ... ${default_file_path} ${log_file_path}
Michael Walsh01bd3682017-01-10 11:21:05 -0600500
David Shawba2d2c22017-01-23 16:56:38 -0600501 [Return] ${log_file_path}
Gunnar Mills9c760342016-12-08 10:12:06 -0600502
David Shawba2d2c22017-01-23 16:56:38 -0600503Create OS Console Command String
504 [Documentation] Return a command string to start OS console logging.
Gunnar Mills9c760342016-12-08 10:12:06 -0600505
David Shawba2d2c22017-01-23 16:56:38 -0600506 # First make sure that the ssh_pw program is available.
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500507 ${cmd_buf}= Catenate which ssh_pw 2>/dev/null || find ${EXECDIR} -name 'ssh_pw'
David Shawba2d2c22017-01-23 16:56:38 -0600508 Rdpissuing ${cmd_buf}
509 ${rc} ${output}= Run And Return Rc And Output ${cmd_buf}
510 Rdpvars rc output
Gunnar Mills9c760342016-12-08 10:12:06 -0600511
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500512 Should Be Equal As Integers 0 ${rc} msg=Could not find ssh_pw.
513
514 ${ssh_pw_file_path}= Set Variable ${output}
George Keishingb45d9522017-06-29 04:20:59 -0500515
516 ${cmd_buf}= Catenate ${ssh_pw_file_path} ${OPENBMC_PASSWORD} -p 2200
George Keishing1f9ec7f2017-06-06 08:59:19 -0500517 ... -o "StrictHostKeyChecking no" ${OPENBMC_USERNAME}@${OPENBMC_HOST}
George Keishing30c12ff2016-09-02 10:25:29 -0500518
David Shawba2d2c22017-01-23 16:56:38 -0600519 [Return] ${cmd_buf}
George Keishing30c12ff2016-09-02 10:25:29 -0500520
Michael Walshcadf1342017-08-28 13:49:25 -0500521Get SOL Console Pid
522 [Documentation] Get the pid of the active sol conole job.
523
524 # Find the pid of the active system console logging session (if any).
525 ${search_string}= Create OS Console Command String
526 # At least in some cases, ps output does not show double quotes so we must
527 # replace them in our search string with the regexes to indicate that they
528 # are optional.
529 ${search_string}= Replace String ${search_string} " ["]?
Michael Walshde7551a2017-10-20 10:53:54 -0500530 ${cmd_buf}= Catenate echo $(ps awwo user,pid,cmd | egrep
531 ... '${search_string}' | egrep -v grep | cut -c10-14)
Michael Walshcadf1342017-08-28 13:49:25 -0500532 Rdpissuing ${cmd_buf}
533 ${rc} ${os_con_pid}= Run And Return Rc And Output ${cmd_buf}
534 Rdpvars os_con_pid
535 # If rc is not zero it just means that there is no OS Console process
536 # running.
537
538 [Return] ${os_con_pid}
539
540
George Keishing30c12ff2016-09-02 10:25:29 -0500541Stop SOL Console Logging
David Shawba2d2c22017-01-23 16:56:38 -0600542 [Documentation] Stop system console logging and return log output.
George Keishing72992e42017-06-16 06:42:36 -0500543 [Arguments] ${log_file_path}=${EMPTY}
544 ... ${targ_file_path}=${EXECDIR}${/}logs${/}
Michael Walsh5f3f4142017-05-22 17:09:47 -0500545 ... ${return_data}=${1}
David Shawba2d2c22017-01-23 16:56:38 -0600546
547 # If there are muliple system console processes, they will all be stopped.
548 # If there is no existing log file this keyword will return an error
549 # message to that effect (and write that message to targ_file_path, if
550 # specified).
551 # NOTE: This keyword will not fail if there is no running system console
552 # process.
Michael Walsh01bd3682017-01-10 11:21:05 -0600553
554 # Description of arguments:
David Shawba2d2c22017-01-23 16:56:38 -0600555 # log_file_path The file path that was used to call "Start SOL
556 # Console Logging". See that keyword (above) for details.
557 # targ_file_path If specified, the file path to which the source
558 # file path (i.e. "log_file_path") should be copied.
Michael Walsh5f3f4142017-05-22 17:09:47 -0500559 # return_data If this is set to ${1}, this keyword will return the SOL
560 # data to the caller as a unicode string.
George Keishing30c12ff2016-09-02 10:25:29 -0500561
David Shawba2d2c22017-01-23 16:56:38 -0600562 ${log_file_path}= Create OS Console File Path ${log_file_path}
Michael Walshcadf1342017-08-28 13:49:25 -0500563
564 ${os_con_pid}= Get SOL Console Pid
George Keishing30c12ff2016-09-02 10:25:29 -0500565
David Shawba2d2c22017-01-23 16:56:38 -0600566 ${cmd_buf}= Catenate kill -9 ${os_con_pid}
567 Run Keyword If '${os_con_pid}' != '${EMPTY}' Rdpissuing ${cmd_buf}
568 ${rc} ${output}= Run Keyword If '${os_con_pid}' != '${EMPTY}'
569 ... Run And Return Rc And Output ${cmd_buf}
570 Run Keyword If '${os_con_pid}' != '${EMPTY}' Rdpvars rc output
George Keishing30c12ff2016-09-02 10:25:29 -0500571
Michael Walsh01bd3682017-01-10 11:21:05 -0600572 Run Keyword If '${targ_file_path}' != '${EMPTY}'
David Shawba2d2c22017-01-23 16:56:38 -0600573 ... Run Keyword And Ignore Error
574 ... Copy File ${log_file_path} ${targ_file_path}
George Keishing30c12ff2016-09-02 10:25:29 -0500575
Michael Walsh5f3f4142017-05-22 17:09:47 -0500576 ${output}= Set Variable ${EMPTY}
577 ${loc_quiet}= Evaluate ${debug}^1
578 ${rc} ${output}= Run Keyword If '${return_data}' == '${1}'
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500579 ... Cmd Fnc cat ${log_file_path} 2>/dev/null quiet=${loc_quiet}
580 ... print_output=${0} show_err=${0}
Michael Walsh5f3f4142017-05-22 17:09:47 -0500581
David Shawba2d2c22017-01-23 16:56:38 -0600582 [Return] ${output}
583
584Start SOL Console Logging
585 [Documentation] Start system console log to file.
Michael Walsh5f3f4142017-05-22 17:09:47 -0500586 [Arguments] ${log_file_path}=${EMPTY} ${return_data}=${1}
David Shawba2d2c22017-01-23 16:56:38 -0600587
588 # This keyword will first call "Stop SOL Console Logging". Only then will
589 # it start SOL console logging. The data returned by "Stop SOL Console
590 # Logging" will in turn be returned by this keyword.
591
592 # Description of arguments:
Michael Walsh5f3f4142017-05-22 17:09:47 -0500593 # log_file_path The file path to which system console log data should be
594 # written. Note that this path is taken to be a location
595 # on the machine where this program is running rather than
596 # on the Open BMC system.
597 # return_data If this is set to ${1}, this keyword will return any SOL
598 # data to the caller as a unicode string.
David Shawba2d2c22017-01-23 16:56:38 -0600599
600 ${log_file_path}= Create OS Console File Path ${log_file_path}
601
602 ${log_output}= Stop SOL Console Logging ${log_file_path}
Michael Walsh5f3f4142017-05-22 17:09:47 -0500603 ... return_data=${return_data}
David Shawba2d2c22017-01-23 16:56:38 -0600604
605 # Validate by making sure we can create the file. Problems creating the
606 # file would not be noticed by the subsequent ssh command because we fork
607 # the command.
608 Create File ${log_file_path}
609 ${sub_cmd_buf}= Create OS Console Command String
610 # Routing stderr to stdout so that any startup error text will go to the
611 # output file.
George Keishing8c3c1df2017-09-13 13:50:20 -0500612 # TODO: Doesn't work with tox so reverting temporarily.
Michael Walsh460042e2017-09-05 16:55:49 -0500613 # nohup detaches the process completely from our pty.
George Keishing8c3c1df2017-09-13 13:50:20 -0500614 #${cmd_buf}= Catenate nohup ${sub_cmd_buf} &> ${log_file_path} &
615 ${cmd_buf}= Catenate ${sub_cmd_buf} > ${log_file_path} 2>&1 &
David Shawba2d2c22017-01-23 16:56:38 -0600616 Rdpissuing ${cmd_buf}
617 ${rc} ${output}= Run And Return Rc And Output ${cmd_buf}
618 # Because we are forking this command, we essentially will never get a
619 # non-zero return code or any output.
620 Should Be Equal ${rc} ${0}
621
Michael Walshcadf1342017-08-28 13:49:25 -0500622 Sleep 1
623 ${os_con_pid}= Get SOL Console Pid
624
625 Should Not Be Empty ${os_con_pid}
626
David Shawba2d2c22017-01-23 16:56:38 -0600627 [Return] ${log_output}
George Keishing30c12ff2016-09-02 10:25:29 -0500628
629Get Time Stamp
630 [Documentation] Get the current time stamp data
631 ${cur_time}= Get Current Date result_format=%Y%m%d%H%M%S%f
Sridevi Rameshb96a0c32016-10-19 05:09:52 -0500632 [Return] ${cur_time}
George Keishing30c12ff2016-09-02 10:25:29 -0500633
George Keishing1b150202016-09-29 08:51:58 -0500634
Rahul Maheshwarif684ba72016-10-25 07:24:41 -0500635Start Journal Log
636 [Documentation] Start capturing journal log to a file in /tmp using
637 ... journalctl command. By default journal log is collected
638 ... at /tmp/journal_log else user input location.
639 ... The File is appended with datetime.
640 [Arguments] ${file_path}=/tmp/journal_log
641
642 Open Connection And Log In
643
644 ${cur_time}= Get Time Stamp
645 Set Global Variable ${LOG_TIME} ${cur_time}
646 Start Command
647 ... journalctl -f > ${file_path}-${LOG_TIME}
648 Log Journal Log Started: ${file_path}-${LOG_TIME}
649
David Shawba2d2c22017-01-23 16:56:38 -0600650
Rahul Maheshwarif684ba72016-10-25 07:24:41 -0500651Stop Journal Log
652 [Documentation] Stop journalctl process if its running.
653 ... By default return log from /tmp/journal_log else
654 ... user input location.
655 [Arguments] ${file_path}=/tmp/journal_log
656
657 Open Connection And Log In
658
659 ${rc}=
660 ... Execute Command
661 ... ps ax | grep journalctl | grep -v grep
662 ... return_stdout=False return_rc=True
663
664 Return From Keyword If '${rc}' == '${1}'
665 ... No journal log process running
666
667 ${output} ${stderr}=
668 ... Execute Command killall journalctl
669 ... return_stderr=True
670 Should Be Empty ${stderr}
671
672 ${journal_log} ${stderr}=
673 ... Execute Command
674 ... cat ${file_path}-${LOG_TIME}
675 ... return_stderr=True
676 Should Be Empty ${stderr}
677
678 Log ${journal_log}
679
680 Execute Command rm ${file_path}-${LOG_TIME}
681
682 [Return] ${journal_log}
Rahul Maheshwari757d80c2016-10-17 01:09:55 -0500683
684Mac Address To Hex String
685 [Documentation] Converts MAC address into hex format.
686 ... Example
687 ... Given the following MAC: 00:01:6C:80:02:78
688 ... This keyword will return: 0x00 0x01 0x6C 0x80 0x02 0x78
689 ... Description of arguments:
Michael Walsh01bd3682017-01-10 11:21:05 -0600690 ... i_macaddress MAC address in the following format
691 ... 00:01:6C:80:02:78
Rahul Maheshwari757d80c2016-10-17 01:09:55 -0500692 [Arguments] ${i_macaddress}
693
694 ${mac_hex}= Catenate 0x${i_macaddress.replace(':', ' 0x')}
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600695 [Return] ${mac_hex}
Rahul Maheshwari757d80c2016-10-17 01:09:55 -0500696
697IP Address To Hex String
698 [Documentation] Converts IP address into hex format.
699 ... Example:
700 ... Given the following IP: 10.3.164.100
701 ... This keyword will return: 0xa 0x3 0xa4 0xa0
702 ... Description of arguments:
Michael Walsh01bd3682017-01-10 11:21:05 -0600703 ... i_ipaddress IP address in the following format
704 ... 10.10.10.10
Rahul Maheshwari757d80c2016-10-17 01:09:55 -0500705 [Arguments] ${i_ipaddress}
706
707 @{ip}= Split String ${i_ipaddress} .
708 ${index}= Set Variable ${0}
709
710 :FOR ${item} IN @{ip}
711 \ ${hex}= Convert To Hex ${item} prefix=0x lowercase=yes
712 \ Set List Value ${ip} ${index} ${hex}
713 \ ${index}= Set Variable ${index + 1}
714 ${ip_hex}= Catenate @{ip}
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600715 [Return] ${ip_hex}
Sivas SRRea85d1f2016-11-13 22:44:28 -0600716
717BMC CPU Performance Check
718 [Documentation] Minimal 10% of proc should be free in this instance
719
720 ${bmc_cpu_usage_output} ${stderr}= Execute Command ${bmc_cpu_usage_cmd}
721 ... return_stderr=True
722 Should be empty ${stderr}
723 ${bmc_cpu_percentage}= Fetch From Left ${bmc_cpu_usage_output} %
724 Should be true ${bmc_cpu_percentage} < 90
725
726BMC Mem Performance Check
727 [Documentation] Minimal 10% of memory should be free in this instance
728
729 ${bmc_mem_free_output} ${stderr}= Execute Command ${bmc_mem_free_cmd}
730 ... return_stderr=True
731 Should be empty ${stderr}
732
733 ${bmc_mem_total_output} ${stderr}= Execute Command ${bmc_mem_total_cmd}
734 ... return_stderr=True
735 Should be empty ${stderr}
736
737 ${bmc_mem_percentage}= Evaluate ${bmc_mem_free_output}*100
738 ${bmc_mem_percentage}= Evaluate
739 ... ${bmc_mem_percentage}/${bmc_mem_total_output}
740 Should be true ${bmc_mem_percentage} > 10
741
Sivas SRRaca55712016-12-21 04:32:35 -0600742BMC File System Usage Check
Sivas SRRc0957412017-10-06 13:02:08 -0500743 [Documentation] Check the file system space. 4 file system should be
744 ... 100% full which is expected
745 # Filesystem Size Used Available Use% Mounted on
746 # /dev/root 14.4M 14.4M 0 100% /
747 # /dev/ubiblock0_0 14.4M 14.4M 0 100% /media/rofs-c9249b0e
748 # /dev/ubiblock8_0 19.6M 19.6M 0 100% /media/pnor-ro-8764baa3
749 # /dev/ubiblock4_0 14.4M 14.4M 0 100% /media/rofs-407816c
Sivas SRRaca55712016-12-21 04:32:35 -0600750 ${bmc_fs_usage_output} ${stderr}= Execute Command
751 ... ${bmc_file_system_usage_cmd} return_stderr=True
752 Should Be Empty ${stderr}
Sivas SRRc0957412017-10-06 13:02:08 -0500753 Should Be True ${bmc_fs_usage_output}==4
Sivas SRRaca55712016-12-21 04:32:35 -0600754
Sivas SRRea85d1f2016-11-13 22:44:28 -0600755Check BMC CPU Performance
756 [Documentation] Minimal 10% of proc should be free in 3 sample
757 :FOR ${var} IN Range 1 4
758 \ BMC CPU Performance check
759
760Check BMC Mem Performance
761 [Documentation] Minimal 10% of memory should be free
762
763 :FOR ${var} IN Range 1 4
764 \ BMC Mem Performance check
765
Sivas SRRaca55712016-12-21 04:32:35 -0600766Check BMC File System Performance
767 [Documentation] Check for file system usage for 4 times
768
769 :FOR ${var} IN Range 1 4
770 \ BMC File System Usage check
771
Rahul Maheshwari63c105b2017-05-12 05:13:52 -0500772Get URL List
773 [Documentation] Return list of URLs under given URL.
774 [Arguments] ${openbmc_url}
775 # Description of argument(s):
Michael Walsh5f3f4142017-05-22 17:09:47 -0500776 # openbmc_url URL for list operation (e.g.
777 # /xyz/openbmc_project/inventory).
Rahul Maheshwari63c105b2017-05-12 05:13:52 -0500778
George Keishing335f5362017-06-30 15:11:20 -0500779 ${url_list}= Read Properties ${openbmc_url}/list quiet=${1}
George Keishing184a89a2017-06-27 07:12:16 -0500780 Sort List ${url_list}
Rahul Maheshwari63c105b2017-05-12 05:13:52 -0500781 [Return] ${url_list}
782
Rahul Maheshwari9a8d3b12016-12-05 04:06:16 -0600783Get Endpoint Paths
784 [Documentation] Returns all url paths ending with given endpoint
785 ... Example:
786 ... Given the following endpoint: cpu
Michael Walsh01bd3682017-01-10 11:21:05 -0600787 ... This keyword will return: list of all urls ending with
788 ... cpu -
Rahul Maheshwari9a8d3b12016-12-05 04:06:16 -0600789 ... /org/openbmc/inventory/system/chassis/motherboard/cpu0,
790 ... /org/openbmc/inventory/system/chassis/motherboard/cpu1
791 ... Description of arguments:
792 ... path URL path for enumeration
793 ... endpoint string for which url path ending
794 [Arguments] ${path} ${endpoint}
795
796 ${resp}= Read Properties ${path}/enumerate timeout=30
797 log Dictionary ${resp}
798
799 ${list}= Get Dictionary Keys ${resp}
800 ${resp}= Get Matches ${list} regexp=^.*[0-9a-z_].${endpoint}[0-9]*$
Gunnar Millsc9ea9362016-12-13 16:21:13 -0600801 [Return] ${resp}
Sridevi Rameshb96a0c32016-10-19 05:09:52 -0500802
803Check Zombie Process
804 [Documentation] Check if any defunct process exist or not on BMC
Michael Walsh01bd3682017-01-10 11:21:05 -0600805 ${count} ${stderr} ${rc}= Execute Command ps -o stat | grep Z | wc -l
Sridevi Rameshb96a0c32016-10-19 05:09:52 -0500806 ... return_stderr=True return_rc=True
807 Should Be True ${count}==0
808 Should Be Empty ${stderr}
George Keishing5327d012016-12-08 08:43:29 -0600809
810Prune Journal Log
811 [Documentation] Prune archived journal logs.
812 [Arguments] ${vacuum_size}=1M
813
814 # This keyword can be used to prevent the journal
815 # log from filling up the /run filesystem.
816 # This command will retain only the latest logs
817 # of the user specified size.
818
819 Open Connection And Log In
820 ${output} ${stderr} ${rc}=
821 ... Execute Command
822 ... journalctl --vacuum-size=${vacuum_size}
823 ... return_stderr=True return_rc=True
824
825 Should Be Equal ${rc} ${0} msg=${stderr}
Sridevi Ramesh1699d372016-12-06 00:20:22 -0600826
827Set BMC Power Policy
828 [Documentation] Set the given BMC power policy.
Michael Walshfdc5ced2017-08-17 13:15:15 -0500829 [Arguments] ${policy}
830
831 # Note that this function will translate the old style "RESTORE_LAST_STATE"
832 # policy to the new style "xyz.openbmc_project.Control.Power.RestorePolicy.
833 # Policy.Restore" for you.
Sridevi Ramesh1699d372016-12-06 00:20:22 -0600834
George Keishing1c3a9662017-08-11 10:16:36 -0500835 # Description of argument(s):
Michael Walshfdc5ced2017-08-17 13:15:15 -0500836 # policy Power restore policy (e.g "RESTORE_LAST_STATE",
837 # ${RESTORE_LAST_STATE}).
838
839 # Set the bmc_power_policy_method to either 'Old' or 'New'.
840 Set Power Policy Method
841 # This translation helps bridge between old and new method for calling.
842 ${policy}= Translate Power Policy Value ${policy}
843 # Run the appropriate keyword.
844 Run Key ${bmc_power_policy_method} Set Power Policy \ ${policy}
845 ${currentPolicy}= Get System Power Policy
846 Should Be Equal ${currentPolicy} ${policy}
847
848New Set Power Policy
849 [Documentation] Set the given BMC power policy (new method).
850 [Arguments] ${policy}
851
852 # Description of argument(s):
853 # policy Power restore policy (e.g. ${RESTORE_LAST_STATE}).
George Keishing1c3a9662017-08-11 10:16:36 -0500854
855 ${valueDict}= Create Dictionary data=${policy}
856 Write Attribute
Michael Walshfdc5ced2017-08-17 13:15:15 -0500857 ... ${POWER_RESTORE_URI} PowerRestorePolicy data=${valueDict}
858
859Old Set Power Policy
860 [Documentation] Set the given BMC power policy (old method).
861 [Arguments] ${policy}
862
863 # Description of argument(s):
864 # policy Power restore policy (e.g. "RESTORE_LAST_STATE").
865
866 ${valueDict}= create dictionary data=${policy}
867 Write Attribute ${HOST_SETTING} power_policy data=${valueDict}
George Keishingcce9df22017-01-24 06:19:33 -0600868
George Keishing4d6f3d62017-02-06 09:50:41 -0600869Get System Power Policy
870 [Documentation] Get the BMC power policy.
Michael Walshfdc5ced2017-08-17 13:15:15 -0500871
872 # Set the bmc_power_policy_method to either 'Old' or 'New'.
873 Set Power Policy Method
874 ${cmd_buf}= Create List ${bmc_power_policy_method} Get Power Policy
875 # Run the appropriate keyword.
876 ${currentPolicy}= Run Keyword @{cmd_buf}
877 [Return] ${currentPolicy}
878
879New Get Power Policy
880 [Documentation] Get the BMC power policy (new method).
George Keishing1c3a9662017-08-11 10:16:36 -0500881 ${currentPolicy}= Read Attribute ${POWER_RESTORE_URI} PowerRestorePolicy
George Keishing4d6f3d62017-02-06 09:50:41 -0600882 [Return] ${currentPolicy}
George Keishingcce9df22017-01-24 06:19:33 -0600883
Michael Walshfdc5ced2017-08-17 13:15:15 -0500884Old Get Power Policy
885 [Documentation] Get the BMC power policy (old method).
886 ${currentPolicy}= Read Attribute ${HOST_SETTING} power_policy
887 [Return] ${currentPolicy}
888
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600889Get Auto Reboot
890 [Documentation] Returns auto reboot setting.
Sweta Potthuri62a23572017-07-28 04:05:13 -0500891 ${setting}= Read Attribute ${CONTROL_HOST_URI}/auto_reboot AutoReboot
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600892 [Return] ${setting}
893
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600894Set Auto Reboot
895 [Documentation] Set the given auto reboot setting.
896 [Arguments] ${setting}
Sweta Potthuri62a23572017-07-28 04:05:13 -0500897 # setting auto reboot's setting, i.e. 1 for enabling and 0 for disabling.
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600898
899 ${valueDict}= Set Variable ${setting}
900 ${data}= Create Dictionary data=${valueDict}
Sweta Potthuri62a23572017-07-28 04:05:13 -0500901 Write Attribute ${CONTROL_HOST_URI}/auto_reboot AutoReboot data=${data}
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600902 ${current_setting}= Get Auto Reboot
Sweta Potthuri62a23572017-07-28 04:05:13 -0500903 Should Be Equal As Integers ${current_setting} ${setting}
Rahul Maheshwari1cbf0042017-02-13 05:17:37 -0600904
905
George Keishingcce9df22017-01-24 06:19:33 -0600906Set BMC Reset Reference Time
907 [Documentation] Set current boot time as a reference and increment
George Keishing80dd5af2017-02-08 07:01:25 -0600908 ... boot count.
George Keishingcce9df22017-01-24 06:19:33 -0600909
910 ${cur_btime}= Get BMC Boot Time
George Keishing80dd5af2017-02-08 07:01:25 -0600911 Run Keyword If ${BOOT_TIME} == ${0} and ${BOOT_COUNT} == ${0}
George Keishingcce9df22017-01-24 06:19:33 -0600912 ... Set Global Variable ${BOOT_TIME} ${cur_btime}
George Keishing80dd5af2017-02-08 07:01:25 -0600913 ... ELSE IF ${cur_btime} > ${BOOT_TIME}
914 ... Run Keywords Set Global Variable ${BOOT_TIME} ${cur_btime}
George Keishingcce9df22017-01-24 06:19:33 -0600915 ... AND
916 ... Set Global Variable ${BOOT_COUNT} ${BOOT_COUNT + 1}
917
George Keishingcce9df22017-01-24 06:19:33 -0600918Get BMC Boot Time
919 [Documentation] Get boot time from /proc/stat.
920
921 Open Connection And Log In
922 ${output} ${stderr}=
923 ... Execute Command egrep '^btime ' /proc/stat | cut -f 2 -d ' '
924 ... return_stderr=True
925 Should Be Empty ${stderr}
926 ${btime}= Convert To Integer ${output}
927 [Return] ${btime}
George Keishingede30002017-02-02 09:33:07 -0600928
George Keishingede30002017-02-02 09:33:07 -0600929Execute Command On BMC
930 [Documentation] Execute given command on BMC and return output.
931 [Arguments] ${command}
932 ${stdout} ${stderr}= Execute Command ${command} return_stderr=True
933 Should Be Empty ${stderr}
934 [Return] ${stdout}
David Shawba2d2c22017-01-23 16:56:38 -0600935
Sridevi Rameshea36b412017-03-09 04:08:02 -0600936
George Keishing7a520222017-02-27 09:44:30 -0600937Enable Core Dump On BMC
938 [Documentation] Enable core dump collection.
939 Open Connection And Log In
940 ${core_pattern}= Execute Command On BMC
941 ... echo '/tmp/core_%e.%p' | tee /proc/sys/kernel/core_pattern
942 Should Be Equal As Strings ${core_pattern} /tmp/core_%e.%p
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600943
Sivas SRR01262bd2017-03-19 10:00:23 -0500944Get Number Of BMC Core Dump Files
945 [Documentation] Get number of core dump files on BMC.
946 Open Connection And Log In
947 ${num_of_core_dump}= Execute Command
948 ... ls /tmp/core* 2>/dev/null | wc -l
949 [Return] ${num_of_core_dump}
950
951Set Core Dump File Size Unlimited
952 [Documentation] Set core dump file size to unlimited.
953 Open Connection And Log In
954 Execute Command On BMC
955 ... ulimit -c unlimited
956
957Check For Core Dumps
958 [Documentation] Check for any core dumps exist.
959 ${output}= Get Number Of BMC Core Dump Files
960 Run Keyword If ${output} > 0
961 ... Log **Warning** BMC core dump files exist level=WARN
962
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600963Trigger Host Watchdog Error
George Keishing37cfa6b2017-06-15 10:25:55 -0500964 [Documentation] Inject host watchdog timeout error via REST.
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600965 [Arguments] ${milliseconds}=1000 ${sleep_time}=5s
Michael Walshb5839d02017-04-12 16:11:20 -0500966 # Description of argument(s):
967 # milliseconds The time watchdog timer value in milliseconds (e.g. 1000 =
968 # 1 second).
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600969 # sleep_time Time delay for host watchdog error to get injected.
970 # Default is 5 seconds.
971
George Keishing37cfa6b2017-06-15 10:25:55 -0500972 ${data}= Create Dictionary data=${True}
973 Write Attribute /xyz/openbmc_project/watchdog/host0 Enabled data=${data}
974
975 ${data}= Create Dictionary data=${milliseconds}
Michael Walsh98d8c9e2017-10-04 12:24:29 -0500976 Write Attribute /xyz/openbmc_project/watchdog/host0 TimeRemaining
977 ... data=${data}
George Keishing37cfa6b2017-06-15 10:25:55 -0500978
Rahul Maheshwarie95622c2017-02-24 10:04:29 -0600979 Sleep ${sleep_time}
Prashanth Kattiae7c2282017-03-15 07:43:46 -0500980
981Login To OS Host
982 [Documentation] Login to OS Host.
983 [Arguments] ${os_host}=${OS_HOST} ${os_username}=${OS_USERNAME}
984 ... ${os_password}=${OS_PASSWORD}
985 # Desription of arguments:
986 # ${os_host} IP address of the OS Host.
987 # ${os_username} OS Host Login user name.
988 # ${os_password} OS Host Login passwrd.
989
990 ${os_state}= Run Keyword And Return Status Ping Host ${os_host}
991 Run Keyword If '${os_state}' == 'False'
992 ... Run Keywords Initiate Host Reboot AND
993 ... Is Host Running AND
994 ... Wait for OS ${os_host} ${os_username} ${os_password}
995
George Keishing3f223b82017-06-28 03:50:35 -0500996 SSHLibrary.Open Connection ${os_host}
Sridevi Rameshea36b412017-03-09 04:08:02 -0600997 ${resp}= Login ${os_username} ${os_password}
998 [Return] ${resp}
Prashanth Katti884ee062017-03-16 05:05:03 -0500999
1000Configure Initial Settings
1001 [Documentation] Restore old IP and route.
1002 ... This keyword requires initial settings viz IP address,
1003 ... Network Mask, default gatway and serial console IP and port
1004 ... information which should be provided in command line.
1005
Michael Walshb5839d02017-04-12 16:11:20 -05001006 [Arguments] ${host}=${OPENBMC_HOST} ${mask}=${NET_MASK}
1007 ... ${gw_ip}=${GW_IP}
Prashanth Katti884ee062017-03-16 05:05:03 -05001008
Michael Walshb5839d02017-04-12 16:11:20 -05001009 # Open telnet connection and ignore the error, in case telnet session is
1010 # already opened by the program calling this keyword.
Prashanth Katti884ee062017-03-16 05:05:03 -05001011
1012 Run Keyword And Ignore Error Open Telnet Connection to BMC Serial Console
1013 Telnet.write ifconfig eth0 ${host} netmask ${mask}
1014 Telnet.write route add default gw ${gw_ip}
George Keishingd05b1082017-03-24 05:27:32 -05001015
1016Install Debug Tarball On BMC
George Keishing55441822017-05-18 14:17:59 -05001017 [Documentation] Copy the debug tar file to BMC and install.
1018 [Arguments] ${tarball_file_path}=${EXECDIR}/obmc-phosphor-debug-tarball-witherspoon.tar.xz
George Keishing5591d332017-09-05 12:57:17 -05001019 ... ${targ_tarball_dir_path}=/tmp/tarball/
George Keishingd05b1082017-03-24 05:27:32 -05001020
George Keishing55441822017-05-18 14:17:59 -05001021 # Description of arguments:
1022 # tarball_file_path Path of the debug tarball file.
1023 # The tar file is downloaded from the build page
1024 # https://openpower.xyz/job/openbmc-build/
1025 # obmc-phosphor-debug-tarball-witherspoon.tar.xz
1026 #
1027 # targ_tarball_dir_path The directory path where the tarball is to be
1028 # installed.
1029
1030 OperatingSystem.File Should Exist ${tarball_file_path}
1031 ... msg=${tarball_file_path} doesn't exist.
1032
1033 # Upload the file to BMC.
George Keishingd05b1082017-03-24 05:27:32 -05001034 Import Library SCPLibrary WITH NAME scp
1035 Open Connection for SCP
George Keishing55441822017-05-18 14:17:59 -05001036 scp.Put File ${tarball_file_path} /tmp/debug-tarball.tar.xz
1037
1038 # Create tarball directory and install.
George Keishing95c371a2017-09-14 15:42:33 -05001039 BMC Execute Command mkdir -p ${targ_tarball_dir_path}
1040 BMC Execute Command
George Keishing55441822017-05-18 14:17:59 -05001041 ... tar -xf /tmp/debug-tarball.tar.xz -C ${targ_tarball_dir_path}
1042
George Keishing95c371a2017-09-14 15:42:33 -05001043 # Remove the tarball file from BMC.
1044 BMC Execute Command rm -f /tmp/debug-tarball.tar.xz
George Keishingd05b1082017-03-24 05:27:32 -05001045
George Keishing55441822017-05-18 14:17:59 -05001046
Sweta Potthuri025e0122017-02-21 00:42:48 -06001047Get BMC Boot Count
1048 [Documentation] Get BMC boot count based on boot time.
1049 ${cur_btime}= Get BMC Boot Time
1050
1051 # Set global variable BOOT_TIME to current boot time if current boot time
1052 # is changed. Also increase value of global variable BOOT_COUNT by 1.
1053 Run Keyword If ${cur_btime} > ${BOOT_TIME}
1054 ... Run Keywords Set Global Variable ${BOOT_TIME} ${cur_btime}
1055 ... AND
1056 ... Set Global Variable ${BOOT_COUNT} ${BOOT_COUNT + 1}
1057 [Return] ${BOOT_COUNT}
1058
1059Set BMC Boot Count
1060 [Documentation] Set BMC boot count to given value.
1061 [Arguments] ${count}
1062
1063 # Description of arguments:
1064 # count boot count value.
1065 ${cur_btime}= Get BMC Boot Time
1066
1067 # Set global variable BOOT_COUNT to given value.
1068 Set Global Variable ${BOOT_COUNT} ${count}
1069
1070 # Set BOOT_TIME variable to current boot time.
1071 Set Global Variable ${BOOT_COUNT} ${count}
Michael Walsh689fbbe2017-04-04 17:58:03 -05001072
Sweta Potthurie5a9fc72017-05-03 07:02:46 -05001073Get System LED State
1074 [Documentation] Return the state of given system LED.
1075 [Arguments] ${led_name}
1076
1077 # Description of argument(s):
1078 # led_name System LED name (e.g. heartbeat, identify, beep).
1079
1080 ${state}= Read Attribute ${LED_PHYSICAL_URI}${led_name} State
1081 [Return] ${state.rsplit('.', 1)[1]}
1082
George Keishing3987a1e2017-09-20 09:13:02 -05001083
George Keishingd2d90af2017-06-27 08:17:34 -05001084Delete Error Logs
Michael Walsh689fbbe2017-04-04 17:58:03 -05001085 [Documentation] Delete error logs.
1086
George Keishingd2d90af2017-06-27 08:17:34 -05001087 # Check if error logs entries exist, if not return.
George Keishing335f5362017-06-30 15:11:20 -05001088 ${resp}= OpenBMC Get Request ${BMC_LOGGING_ENTRY}${/}list quiet=${1}
George Keishingd2d90af2017-06-27 08:17:34 -05001089 Return From Keyword If ${resp.status_code} == ${HTTP_NOT_FOUND}
1090
1091 # Get the list of error logs entries and delete them all.
George Keishing335f5362017-06-30 15:11:20 -05001092 ${elog_entries}= Get URL List ${BMC_LOGGING_ENTRY}
George Keishingd2d90af2017-06-27 08:17:34 -05001093 :FOR ${entry} IN @{elog_entries}
1094 \ Delete Error Log Entry ${entry}
George Keishingdb34c2f2017-04-18 13:20:25 -05001095
George Keishing3987a1e2017-09-20 09:13:02 -05001096
George Keishingd2d90af2017-06-27 08:17:34 -05001097Delete Error Log Entry
George Keishingdb34c2f2017-04-18 13:20:25 -05001098 [Documentation] Delete error log entry.
1099 [Arguments] ${entry_path}
1100
1101 # Description of argument(s):
1102 # entry_path Delete an error log entry.
1103 # Ex. /xyz/openbmc_project/logging/entry/1
1104
George Keishing6a8ed0f2017-07-11 22:54:42 -05001105 # Skip delete if entry URI is a callout.
1106 # Example: /xyz/openbmc_project/logging/entry/1/callout
1107 Return From Keyword If '${entry_path.rsplit('/', 1)[1]}' == 'callout'
1108
George Keishingdb34c2f2017-04-18 13:20:25 -05001109 ${data}= Create Dictionary data=@{EMPTY}
1110 ${resp}= Openbmc Delete Request ${entry_path} data=${data}
1111 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
Rahul Maheshwari43be6932017-05-01 02:37:06 -05001112
1113
George Keishingcc71c3c2017-09-20 09:38:03 -05001114Delete All Error Logs
George Keishing3987a1e2017-09-20 09:13:02 -05001115 [Documentation] Delete all error log entries using "DeleteAll" interface.
1116
1117 ${data}= Create Dictionary data=@{EMPTY}
1118 ${resp}= Openbmc Post Request ${BMC_LOGGING_URI}action/DeleteAll
1119 ... data=${data}
1120 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
1121
1122
Rahul Maheshwari43be6932017-05-01 02:37:06 -05001123Get LED State XYZ
1124 [Documentation] Returns state of given LED.
1125 [Arguments] ${led_name}
1126 # Description of argument(s):
1127 # led_name Name of LED
1128
1129 ${state}= Read Attribute ${LED_GROUPS_URI}${led_name} Asserted
1130 [Return] ${state}
Rahul Maheshwari13256d92017-06-15 10:05:40 -05001131
1132
1133Get BMC Version
1134 [Documentation] Returns BMC version from /etc/os-release.
1135 ... e.g. "v1.99.6-141-ge662190"
1136
1137 Open Connection And Log In
1138 ${cmd}= Set Variable grep ^VERSION_ID= /etc/os-release | cut -f 2 -d '='
1139 ${output}= Execute Command On BMC ${cmd}
1140 [Return] ${output}
1141
George Keishingad5817a2017-06-28 10:19:03 -05001142
Charles Paul Hofere43fb2f2017-09-26 15:36:18 -05001143Get PNOR Version
1144 [Documentation] Get the PNOR version from the BMC.
1145
1146 ${pnor_attrs}= Get PNOR Attributes
1147 [Return] ${pnor_attrs['version']}
1148
1149
1150Get PNOR Attributes
1151 [Documentation] Return PNOR software attributes as a dictionary.
1152
Michael Walsh98d8c9e2017-10-04 12:24:29 -05001153 # This keyword parses /var/lib/phosphor-software-manager/pnor/ro/pnor.toc
1154 # into key/value pairs.
Charles Paul Hofere43fb2f2017-09-26 15:36:18 -05001155
1156 ${outbuf} ${stderr} ${rc}= BMC Execute Command
1157 ... cat /var/lib/phosphor-software-manager/pnor/ro/pnor.toc
1158 ${pnor_attrs}= Key Value Outbuf To Dict ${outbuf} delim==
1159
1160 [Return] ${pnor_attrs}
1161
1162
George Keishingad5817a2017-06-28 10:19:03 -05001163Get Elog URL List
1164 [Documentation] Return error log entry list of URLs.
1165
1166 ${url_list}= Read Properties /xyz/openbmc_project/logging/entry/
1167 Sort List ${url_list}
1168 [Return] ${url_list}
1169
1170
Steven Sombaraaf72c42017-09-05 12:02:00 -05001171Read Turbo Setting Via REST
1172 [Documentation] Return turbo setting via REST.
1173
1174 ${resp}= OpenBMC Get Request ${SENSORS_URI}host/TurboAllowed
1175 ${jsondata}= To JSON ${resp.content}
1176 Should Be Equal As Strings ${resp.status_code} ${HTTP_OK}
1177 [Return] ${jsondata["data"]["value"]}
1178
1179
Steven Sombaraaf72c42017-09-05 12:02:00 -05001180Set Turbo Setting Via REST
1181 [Documentation] Set turbo setting via REST.
1182 [Arguments] ${setting}
1183 # Description of argument(s):
1184 # setting Value which needs to be set.(i.e. False or True)
1185
1186 ${valueDict}= Create Dictionary data=${setting}
1187 Write Attribute ${SENSORS_URI}host/TurboAllowed value data=${valueDict}
George Keishingef74a8c2017-10-20 10:23:52 -05001188
George Keishingef74a8c2017-10-20 10:23:52 -05001189Set Control Boot Mode
1190 [Documentation] Set given boot mode on the boot object path attribute.
1191 [Arguments] ${boot_path} ${boot_mode}
1192
1193 # Description of argument(s):
1194 # boot_path Boot object path.
1195 # Example:
1196 # /xyz/openbmc_project/control/host0/boot
1197 # /xyz/openbmc_project/control/host0/boot/one_time
1198 # boot_mode Boot mode which need to be set.
1199 # Example:
1200 # "xyz.openbmc_project.Control.Boot.Mode.Modes.Regular"
1201
1202 ${valueDict}= Create Dictionary data=${boot_mode}
1203 Write Attribute ${boot_path} BootMode data=${valueDict}
Sridevi Ramesh0d88ab32017-09-21 11:07:28 -05001204
1205Copy Address Translation Utils To HOST OS
1206 [Documentation] Copy address translation utils to host OS.
1207
1208 OperatingSystem.File Should Exist ${probe_cpu_tool_path}
1209 ... msg=${probe_cpu_tool_path} doesn't exist.
1210 OperatingSystem.File Should Exist ${probe_cpu_tool_path}
1211 ... msg=${probe_cpu_tool_path} doesn't exist.
1212
1213 scp.Open connection ${OS_HOST} username=${OS_USERNAME}
1214 ... password=${OS_PASSWORD}
1215 scp.Put File ${probe_cpu_tool_path} ${target_file_path}
1216 scp.Put File ${scom_addrs_tool_path} ${target_file_path}