Our performance QA tests are intended to alert us if some common
task suddenly takes longer. To serve this purpose, they need to provide
reproducible results. Hence avoid any interference with watcher-submitted
jobs by pausing the watcher during performance QA tests.
Signed-off-by: Klaus Aehlig <aehlig@google.com>
Reviewed-by: Oleg Ponomarev <oponomarev@google.com>
ReportTestSkip("performance related tests", "performance")
return
+ # For reproducable performance, run performance tests with the watcher
+ # paused.
+ qa_utils.AssertCommand(["gnt-cluster", "watcher", "pause", "4h"])
+
if qa_config.TestEnabled("jobqueue-performance"):
RunTest(qa_performance.TestParallelMaxInstanceCreationPerformance)
RunTest(qa_performance.TestParallelNodeCountInstanceCreationPerformance)
finally:
qa_config.ReleaseManyNodes(inodes)
+ qa_utils.AssertCommand(["gnt-cluster", "watcher", "continue"])
+
def RunQa():
"""Main QA body.