OCaml Forge
Tracker
SCM

Detail: [#1096] Be smart when running tests

Feature Requests: Browse | Download .csv | Monitor

[#1096] Be smart when running tests

Date:
2012-02-22 21:02		 Priority:
3
State:
Open
Submitted by:
Sylvain Le Gall (gildor-admin) 		Assigned to:
Sylvain Le Gall (gildor-admin)
Component:
General		 Operating System:
None
Product:
ounit		  
Summary:
Be smart when running tests

Detailed description
90% of the changes in TESTFLAGS in oasis test suite are restricting tests run to the last one which was failing.

This task can be done automatically by ounit itself:
* run once
* write tests that failed + their timing in a file ounit.state / _build/ounit.state
* let the user fix the test
* read ounit.state
* run tests with the one failing first and the fastest
* allow to run all tests in level + 1 as well (may code this possibilty in >::)
* if one the previous fail, skip the remaining

Followup

Message
Date: 2013-03-02 22:13
Sender: Thomas Wickham

Is it really "smart" to focus on only one test ?

True thing, we want our test to pass, obviously. True also that waiting a dozen of seconds before seeing THE test passing or failing *is* boring. But more than all, we don't want to broke anything !

I suggest that a smart behavior will be to change the sequence and put the failing tests in first.

Attached Files:

Changes:

No Changes Have Been Made to This Item