OCaml Forge
SCM

Detail: [#1096] Be smart when running tests

Feature Requests: Browse | Download .csv | Monitor

[#1096] Be smart when running tests

Date:
2012-02-22 21:02
Priority:
3
State:
Closed
Submitted by:
Sylvain Le Gall (gildor-admin)
Assigned to:
Sylvain Le Gall (gildor-admin)
Component:
General
Operating System:
None
Product:
ounit
 
Summary:
Be smart when running tests

Detailed description
90% of the changes in TESTFLAGS in oasis test suite are restricting tests run to the last one which was failing.

This task can be done automatically by ounit itself:
* run once
* write tests that failed + their timing in a file ounit.state / _build/ounit.state
* let the user fix the test
* read ounit.state
* run tests with the one failing first and the fastest
* allow to run all tests in level + 1 as well (may code this possibilty in >::)
* if one the previous fail, skip the remaining

Followup

Message
Date: 2013-09-30 00:39
Sender: Sylvain Le Gall

Close with OUnit v2.0.0. We reorder the test to get the failing one first and skipped the other if still failing.
Date: 2013-03-02 22:13
Sender: Thomas Wickham

Is it really "smart" to focus on only one test ?

True thing, we want our test to pass, obviously. True also that waiting a dozen of seconds before seeing THE test passing or failing *is* boring. But more than all, we don't want to broke anything !

I suggest that a smart behavior will be to change the sequence and put the failing tests in first.

Attached Files:

Changes:

Field Old Value Date By
status_idOpen2013-09-30 00:39gildor-admin
close_dateNone2013-09-30 00:39gildor-admin