This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.
Summary: | Not all test results displayed when running Surefire in parallel | ||
---|---|---|---|
Product: | java | Reporter: | Jesse Glick <jglick> |
Component: | JUnit | Assignee: | Theofanis Oikonomou <theofanis> |
Status: | VERIFIED FIXED | ||
Severity: | normal | CC: | anebuzelsky, jkovalsky, mkleint, mmirilovic |
Priority: | P1 | ||
Version: | 7.3 | ||
Hardware: | PC | ||
OS: | Linux | ||
Issue Type: | DEFECT | Exception Reporter: |
Description
Jesse Glick
2013-01-03 22:04:39 UTC
Changeset: 8a5f44e27c89 Author: Theofanis Oikonomou <theofanis@netbeans.org> Date: 2013-11-21 12:22 Message: Changeset: 5abb65271023 Author: Theofanis Oikonomou <theofanis@netbeans.org> Date: 2013-11-21 16:38 Message: - additional fix to use maven api Integrated into 'main-silver', will be available in build *201311230002* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress) Changeset: http://hg.netbeans.org/main-silver/rev/5abb65271023 User: Theofanis Oikonomou <theofanis@netbeans.org> Log: - additional fix to use maven api Task #224442 - Not all test results displayed when running Surefire in parallel Well now in 20140317-eacabc97e7bc all the results *are* displayed, but only after the entire Maven test run has completed—there is no incremental display. (In reply to Jesse Glick from comment #4) > Well now in 20140317-eacabc97e7bc all the results *are* displayed, but only > after the entire Maven test run has completed—there is no incremental > display. Correct me if I am wrong, but I think this is due to the fact that surefire is dumbing output after all tests are finished, when run in parallel mode. So until all tests are done the output-listener is not notified and thus not updating the UI. Not much can be done in this case in nb side. (In reply to Theofanis Oikonomou from comment #5) > I think this is due to the fact that surefire > is dum[p]ing output after all tests are finished, when run in parallel mode. Not true. Using maven-surefire-plugin:2.17:test, Maven shows output as suites finish: Running Test1 Running Test2 Running Test3 Running Test4 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.482 sec - in Test2 Running Test5 Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.512 sec - in Test3 Running Test6 Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.782 sec - in Test1 Running Test7 … and target/surefire-reports/TEST-*.xml (as well as *.txt and *-output.txt) appear as soon as each suite is finished as well. Yet NetBeans (20140619-c7b326d0638f) just shows “Running…” until the very end, 5½ minutes later. Changeset: b279011db3c0 Author: Theofanis Oikonomou <theofanis@netbeans.org> Date: 2014-06-27 20:15 Message: It should be fixed now. I had some issues when using reuseForks=true and a forkCount value larger than one. The same output was shown in the output window. I think I handled this case effectively as to not show multiple nodes for the same test class. NOt sure if I missed something critical though. Any insight would be much appreciated. Thanks Integrated into 'main-silver', will be available in build *201407010002* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress) Changeset: http://hg.netbeans.org/main-silver/rev/b279011db3c0 User: Theofanis Oikonomou <theofanis@netbeans.org> Log: Task #224442 - Not all test results displayed when running Surefire in parallel 20140818-f47eef37f759 test results are not displayed at all even when running a single test case, never mind parallel tests. The Test Results window opens but just says
> No tests executed.(0.0 s)
CoS, github.com/jenkinsci/jenkins/test/src/test/java/**/*Test.java.
Changeset: 36170197fc52 Author: Theofanis Oikonomou <theofanis@netbeans.org> Date: 2014-08-21 18:05 Message: reproducible in latest build. Should be fixed now. Jirko can this make it in 8.0.1? Thanks No, it's too late for 8.0.1. I am sorry. The fix will be available in NetBeans 8.1. As a serious regression against NetBeans 8.0 this must be fixed in 8.0.1 timeframe. Increasing priority to reflect showstopper status. Backported to release801: http://hg.netbeans.org/releases/rev/bf8eac8b4a82 Bug reproduced in: Product Version: NetBeans IDE 8.0.1 (Build 201408212300) Java: 1.7.0_67; Java HotSpot(TM) 64-Bit Server VM 24.65-b04 Runtime: Java(TM) SE Runtime Environment 1.7.0_67-b01 System: Linux version 3.13.0-24-generic running on amd64; UTF-8; en_US (nb) Returning correct TM. Sorry for spamming. Glad I reported that! Will recheck once this gets into main-silver. Integrated into 'main-silver', will be available in build *201408230001* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress) Changeset: http://hg.netbeans.org/main-silver/rev/36170197fc52 User: Theofanis Oikonomou <theofanis@netbeans.org> Log: Task #224442 - Not all test results displayed when running Surefire in parallel Integrated into 'releases/release801', will be available in build *201408222300* or newer. Wait for official and publicly available build. Changeset: http://hg.netbeans.org/releases/rev/bf8eac8b4a82 User: Theofanis Oikonomou <theofanis@netbeans.org> Log: Task #224442 - Not all test results displayed when running Surefire in parallel Product Version: NetBeans IDE 8.0.1 (Build 201408222300) Java: 1.8.0_20; Java HotSpot(TM) 64-Bit Server VM 25.20-b23 Runtime: Java(TM) SE Runtime Environment 1.8.0_20-b31 System: Linux version 3.13.0-24-generic running on amd64; UTF-8; en_US (nb) Works like a charm. Test results window now displays errors correctly and updates itself incrementally if tests are run in parallel. Verified. Finally working smoothly in 20140825-9a94e8cb336b, thanks! |