Performance test summary says PASS even if the memory limit
is exceeded. It currently only looks at time.
Issue-ID: CPS-1753
Signed-off-by: danielhanrahan <daniel.hanrahan@est.tech>
Change-Id: I6b9d5ae8e8f560459ba77cdb8fe8b889d0dc7a8a
abstract def createInitialData()
def recordAndAssertResourceUsage(String shortTitle, double thresholdInSec, double recordedTimeInSec, memoryLimit, memoryUsageInMB) {
- def pass = recordedTimeInSec <= thresholdInSec
+ def pass = recordedTimeInSec <= thresholdInSec && memoryUsageInMB <= memoryLimit
if (shortTitle.length() > 40) {
shortTitle = shortTitle.substring(0, 40)
}