My favorites | Sign in
Project Home Downloads Wiki Issues Source
READ-ONLY: This project has been archived. For more information see this post.
Search
for
  Advanced search   Search tips   Subscriptions
Issue 12: Wrong report of number of tests run in maven
1 person starred this issue and may be notified of changes. Back to list
Status:  Fixed
Owner:  ----
Closed:  Jun 2011


 
Reported by al...@fastmail.net, May 25, 2011
When running acceptance tests, the numbers printed by maven are wrong.

1) In the case below, 3 scenarios of one story are run. The scenarios seem to be run twice, ending up with two report lines.

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running com.XXXX.acceptance.TestStory
Running com.XXXX.acceptance.TestStory
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.04 sec
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.275 sec

Results :

Tests run: 3, Failures: 0, Errors: 0, Skipped: 0


2) In the case below, the same 3 scenarios are run. Now they are set to pending state. The first report line says that 6(?) scenarios have been run, with 3 being ignored. The second report line is useless.

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running com.XXXX.acceptance.TestStory
Running com.XXXX.acceptance.TestStory
Tests run: 6, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0.035 sec
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.25 sec

Results :

Tests run: 6, Failures: 0, Errors: 0, Skipped: 3

May 27, 2011
Project Member #1 lipinski...@gmail.com
On the other hand eclipse junit runner shows them properly. Will look into surefire...
Status: Accepted
Jun 14, 2011
Project Member #3 lipinski...@gmail.com
Fixed. Indeed pending scenarios were handled improperly. Though the real reason is that JUnit's describeChild method has side effects (increases counters) - haven't Kent Beck read Clean Code? ;-)
Status: Fixed
Jun 15, 2011
#4 al...@fastmail.net
Thanks!! 

Is it in the upcoming release?
Jun 15, 2011
Project Member #5 lipinski...@gmail.com
Yep.
You can check it now by taking the version 0.3.1-SNAPSHOT. It's in sonatype's snapshots' repo.

Powered by Google Project Hosting