| *** Settings *** |
| |
| Documentation Stress the system using HTX exerciser. |
| |
| # Test Parameters: |
| # OPENBMC_HOST The BMC host name or IP address. |
| # OS_HOST The OS host name or IP Address. |
| # OS_USERNAME The OS login userid (usually root). |
| # OS_PASSWORD The password for the OS login. |
| # HTX_DURATION Duration of HTX run, for example, 8 hours, or |
| # 30 minutes. |
| # HTX_LOOP The number of times to loop HTX. |
| # HTX_INTERVAL The time delay between consecutive checks of HTX |
| # status, for example, 30s. |
| # In summary: Run HTX for $HTX_DURATION, looping |
| # $HTX_LOOP times checking every $HTX_INTERVAL. |
| # HTX_KEEP_RUNNING If set to 1, this indicates that the HTX is to |
| # continue running after an error. |
| # CHECK_INVENTORY If set to 0 or False, OS inventory checking before |
| # and after each HTX run will be disabled. This |
| # parameter is optional. |
| # PREV_INV_FILE_PATH The file path and name of an initial previous |
| # inventory snapshot file in JSON format. Inventory |
| # snapshots taken before and after each HTX run will |
| # be compared to this file. |
| # This parameter is optional. If not specified, an |
| # initial inventory snapshot will be taken before |
| # HTX startup. |
| # INV_IGNORE_LIST A comma-delimited list of strings that |
| # indicate what to ignore if there are inventory |
| # differences, (e.g., processor "size"). |
| # If differences are found during inventory checking |
| # and those items are in this list, the |
| # differences will be ignored. This parameter is |
| # optional. If not specified the default value is |
| # "size". |
| |
| Resource ../syslib/utils_os.robot |
| Library ../syslib/utils_keywords.py |
| Library ../lib/utils_files.py |
| |
| Suite Setup Run Keyword Start SOL Console Logging |
| Test Setup Pre Test Case Execution |
| Test Teardown Post Test Case Execution |
| |
| |
| *** Variables **** |
| |
| ${stack_mode} skip |
| ${json_initial_file_path} ${EXECDIR}/os_inventory_initial.json |
| ${json_final_file_path} ${EXECDIR}/os_inventory_final.json |
| ${json_diff_file_path} ${EXECDIR}/os_inventory_diff.json |
| ${last_inventory_file_path} ${EMPTY} |
| ${CHECK_INVENTORY} True |
| ${INV_IGNORE_LIST} size |
| ${PREV_INV_FILE_PATH} ${EMPTY} |
| |
| |
| *** Test Cases *** |
| |
| Hard Bootme Test |
| [Documentation] Stress the system using HTX exerciser. |
| [Tags] Hard_Bootme_Test |
| |
| # Set last inventory file to PREV_INV_FILE_PATH otherwise set it |
| # to ${EMPTY}. |
| ${last_inventory_file_path}= Get Variable Value ${PREV_INV_FILE_PATH} |
| ... ${EMPTY} |
| |
| Rprintn |
| Rpvars HTX_DURATION HTX_INTERVAL CHECK_INVENTORY INV_IGNORE_LIST |
| ... PREV_INV_FILE_PATH |
| |
| Run Keyword If '${last_inventory_file_path}' != '${EMPTY}' |
| ... OperatingSystem.File Should Exist ${last_inventory_file_path} |
| |
| Set Suite Variable ${last_inventory_file_path} children=true |
| Set Suite Variable ${INV_IGNORE_LIST} children=true |
| Set Suite Variable ${iteration} ${0} children=true |
| |
| Repeat Keyword ${HTX_LOOP} times Run HTX Exerciser |
| |
| |
| *** Keywords *** |
| |
| |
| Run HTX Exerciser |
| [Documentation] Run HTX exerciser. |
| # Test Flow: |
| # - Power on. |
| # - Establish SSH connection session. |
| # - Do inventory collection, compare with |
| # previous inventory run if applicable. |
| # - Create HTX mdt profile. |
| # - Run HTX exerciser. |
| # - Check HTX status for errors. |
| # - Do inventory collection, compare with |
| # previous inventory run. |
| # - Power off. |
| |
| Set Suite Variable ${iteration} ${iteration + 1} |
| ${loop_count}= Catenate Starting iteration: ${iteration} |
| Rpvars loop_count |
| |
| Boot To OS |
| |
| # Post Power off and on, the OS SSH session needs to be established. |
| Login To OS |
| |
| Run Keyword If '${CHECK_INVENTORY}' == 'True' |
| ... Do Inventory And Compare ${json_initial_file_path} |
| ... ${last_inventory_file_path} |
| |
| Run Keyword If '${HTX_MDT_PROFILE}' == 'mdt.bu' |
| ... Create Default MDT Profile |
| |
| Run MDT Profile |
| |
| Loop HTX Health Check |
| |
| Shutdown HTX Exerciser |
| |
| Run Keyword If '${CHECK_INVENTORY}' == 'True' |
| ... Do Inventory And Compare ${json_final_file_path} |
| ... ${last_inventory_file_path} |
| |
| Power Off Host |
| |
| # Close all SSH and REST active sessions. |
| Close All Connections |
| Flush REST Sessions |
| |
| Rprint Timen HTX Test ran for: ${HTX_DURATION} |
| |
| ${loop_count}= Catenate Ending iteration: ${iteration} |
| Rpvars loop_count |
| |
| |
| Do Inventory And Compare |
| [Documentation] Do inventory and compare. |
| [Arguments] ${inventory_file_path} ${last_inventory_file_path} |
| # Description of argument(s): |
| # inventory_file_path The file to receive the inventory snapshot. |
| # last_inventory_file_path The previous inventory to compare with. |
| |
| Create JSON Inventory File ${inventory_file_path} |
| Run Keyword If '${last_inventory_file_path}' != '${EMPTY}' |
| ... Compare Json Inventory Files ${inventory_file_path} |
| ... ${last_inventory_file_path} |
| ${last_inventory_file_path}= Set Variable ${inventory_file_path} |
| Set Suite Variable ${last_inventory_file_path} children=true |
| |
| |
| Compare Json Inventory Files |
| [Documentation] Compare JSON inventory files. |
| [Arguments] ${file1} ${file2} |
| # Description of argument(s): |
| # file1 A file that has an inventory snapshot in JSON format. |
| # file2 A file that has an inventory snapshot, to compare with file1. |
| |
| ${diff_rc}= File_Diff ${file1} |
| ... ${file2} ${json_diff_file_path} ${INV_IGNORE_LIST} |
| Run Keyword If '${diff_rc}' != '${0}' |
| ... Report Inventory Mismatch ${diff_rc} ${json_diff_file_path} |
| |
| |
| Report Inventory Mismatch |
| [Documentation] Report inventory mismatch. |
| [Arguments] ${diff_rc} ${json_diff_file_path} |
| # Description of argument(s): |
| # diff_rc The failing return code from the difference check. |
| # json_diff_file_path The file that has the latest inventory snapshot. |
| |
| Log To Console Significant difference in inventory found, rc=${diff_rc} |
| Log To Console Differences are listed in file: no_newline=true |
| Log To Console ${json_diff_file_path} |
| Log To Console File Contents: |
| Wait Until Created ${json_diff_file_path} |
| ${file_contents}= OperatingSystem.Get File ${json_diff_file_path} |
| Log ${file_contents} level=WARN |
| Fail Significant difference in inventory found, rc=${diff_rc} |
| |
| |
| Loop HTX Health Check |
| [Documentation] Run until HTX exerciser fails. |
| Repeat Keyword ${HTX_DURATION} |
| ... Run Keywords Check HTX Run Status |
| ... AND Sleep ${HTX_INTERVAL} |
| |
| |
| Post Test Case Execution |
| [Documentation] Do the post test teardown. |
| # 1. Shut down HTX exerciser if test Failed. |
| # 2. Capture FFDC on test failure. |
| # 3. Close all open SSH connections. |
| |
| # Keep HTX running if user set HTX_KEEP_RUNNING to 1. |
| Run Keyword If |
| ... '${TEST_STATUS}' == 'FAIL' and ${HTX_KEEP_RUNNING} == ${0} |
| ... Shutdown HTX Exerciser |
| |
| ${keyword_buf}= Catenate Stop SOL Console Logging |
| ... \ targ_file_path=${EXECDIR}${/}logs${/}SOL.log |
| Run Key ${keyword_buf} |
| |
| FFDC On Test Case Fail |
| Close All Connections |