Handling continuously failing test cases while running entire test bucket.
This change includes:
- Added known_issue tag for test cases failing due to existing issues.
And where fix for the issue is expected to take little long time.
- With each tag addition also added github issue number.
Benefits:
- Failing test cases can be excluded while running entire bucket
using --exclude known_issue as suffix
- Continuously failing test cases will have related issue number
in document section.
Change-Id: I18c40b97a25eff947a5922e4abfacde07fe19a6b
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>
diff --git a/tests/test_generic_conf.robot b/tests/test_generic_conf.robot
index b27d32a..bdd6c97 100755
--- a/tests/test_generic_conf.robot
+++ b/tests/test_generic_conf.robot
@@ -38,29 +38,33 @@
[Documentation] ***BAD PATH***
... This test case set the power values with string of characters
... Expectation is to return error.
+ ... Existing Issue: https://github.com/openbmc/openbmc/issues/552
+ [Tags] known_issue
${valueToBeSet}= Set Variable abcdefg
${valueDict}= create dictionary data=${valueToBeSet}
Write Attribute /org/openbmc/settings/host0 power_cap data=${valueDict}
- ${value}= Read Attribute /org/openbmc/settings/host0 power_cap
+ ${value}= Read Attribute /org/openbmc/settings/host0 power_cap
should not be true '${value}'=='${valueToBeSet}'
Set the power with greater then MAX_POWER_VALUE
[Documentation] ***BAD PATH***
- ... This test case sets the power value which is greater
+ ... This test case sets the power value which is greater
... then MAX_ALLOWED_VALUE,Expectation is to return error
+ ... Existing Issue: https://github.com/openbmc/openbmc/issues/552
+ [Tags] known_issue
${valueToBeSet}= Set Variable ${1010}
${valueDict}= create dictionary data=${valueToBeSet}
Write Attribute /org/openbmc/settings/host0 power_cap data=${valueDict}
${value}= Read Attribute /org/openbmc/settings/host0 power_cap
- should not be equal ${value} ${valueToBeSet}
+ should not be equal ${value} ${valueToBeSet}
Set the power with MIN_POWER_VALUE
[Documentation] ***BAD PATH***
- ... This test case sets the power value less then
+ ... This test case sets the power value less then
... MIN_ALLOWED_VALUE,Expectation is it should get error.
${valueToBeSet}= Set Variable ${MIN_POWER_VALUE}
@@ -74,7 +78,7 @@
[Documentation] ***GOOD PATH***
... This test case sets the power value with MAX_POWER_VALUE
... and it should be set.
-
+
${valueToBeSet}= Set Variable ${MAX_POWER_VALUE}
${valueDict}= create dictionary data=${valueToBeSet}
Write Attribute /org/openbmc/settings/host0 power_cap data=${valueDict}
@@ -84,8 +88,10 @@
Set the boot flags with string
[Documentation] ***BAD PATH***
- ... This test case sets the boot flag with some invalid string
+ ... This test case sets the boot flag with some invalid string
... Expectation is it should not be set.
+ ... Existing Issue: https://github.com/openbmc/openbmc/issues/552
+ [Tags] known_issue
${valueToBeSet}= Set Variable 3ab56f
${valueDict} = create dictionary data=${valueToBeSet}