Loop test invoke with command passing as argument
What this fix focuses
- Enabled to run any test(s) in loop
- Updated README
- IP address removed to publish the result
Resolves openbmc/openbmc-test-automation#168
Change-Id: I75931193bdae0f140d83a941f3356521ae911c94
Signed-off-by: Sivas SRR <sivas.srr@in.ibm.com>
diff --git a/README.md b/README.md
index c00aa00..99f22b9 100755
--- a/README.md
+++ b/README.md
@@ -114,6 +114,11 @@
For Barreleye system
python -m robot -v OPENBMC_HOST:x.x.x.x -v FILE_PATH:downloaded_path/barreleye-xxxx.all.tar extended/code_update/update_bmc.robot
+
+ For loop test (Default iteration is 10)
+ python -m robot -v OPENBMC_HOST:x.x.x.x -v OPENBMC_SYSTEMMODEL:xxxxxx -v ITERATION:n -v LOOP_TEST_COMMAND:xxxxxx extended/full_suite_regression.robot
+ Below is sample command using tox to test only fw version using Barreleye system for 5 times
+ OPENBMC_HOST=x.x.x.x LOOP_TEST_COMMAND="--argumentfile test_lists/skip_test tests/test_fw_version.robot" ITERATION=5 OPENBMC_SYSTEMMODEL=barreleye tox -e barreleye -- ./extended/full_suite_regression.robot
```
Jenkins jobs tox commands
diff --git a/extended/full_suite_regression.robot b/extended/full_suite_regression.robot
index 19c9fa4..dccc67b 100755
--- a/extended/full_suite_regression.robot
+++ b/extended/full_suite_regression.robot
@@ -8,6 +8,7 @@
*** Variables ***
${ITERATION} 10
${RESULT_PATH} logsdir
+ ${LOOP_TEST_COMMAND} tests
*** Test Cases ***
Run Entire Test Suite Multiple Time
@@ -18,7 +19,8 @@
: FOR ${INDEX} IN RANGE 0 ${ITERATION}
\ Log To Console \n Iteration: no_newline=True
\ Log To Console ${INDEX}
- \ Run OPENBMC_HOST=${OPENBMC_HOST} tox -e ${OPENBMC_SYSTEMMODEL} -- tests
+ \ Run OPENBMC_HOST=${OPENBMC_HOST} tox -e ${OPENBMC_SYSTEMMODEL} -- ${LOOP_TEST_COMMAND}
+ \ Run sed -i 's/'${OPENBMC_HOST}'/DUMMYIP/g' output.xml
\ Copy File output.xml ${RESULT_PATH}/output${INDEX}.xml
\ Copy File log.html ${RESULT_PATH}/log${INDEX}.html
diff --git a/tools/generate_argumentfile.sh b/tools/generate_argumentfile.sh
index 281ed19..0d70f0d 100755
--- a/tools/generate_argumentfile.sh
+++ b/tools/generate_argumentfile.sh
@@ -16,3 +16,5 @@
echo "--variable HTTPS_PORT:$HTTPS_PORT" >> $ARG_FILE
echo "--variable PNOR_IMAGE_PATH:$PNOR_IMAGE_PATH" >> $ARG_FILE
echo "--variable IPMI_COMMAND:$IPMI_COMMAND" >> $ARG_FILE
+echo "--variable ITERATION:$ITERATION" >> $ARG_FILE
+echo "--variable LOOP_TEST_COMMAND:$LOOP_TEST_COMMAND" >> $ARG_FILE