This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.
20130102-2aaac3cd1678, JDK 7u9, Linux. Have open Jenkins sources from a branch using parallel Surefire [1]. Ran tests on a package: cd …/test; JAVA_HOME=… …/java/maven/bin/mvn -Dtest=hudson.console.*Test test-compile surefire:test The Maven output looks fine: T E S T S ------------------------------------------------------- Running hudson.console.ExceptionAnnotationTest Running hudson.console.ConsoleAnnotatorTest Running hudson.console.UrlAnnotatorTest … Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.386 sec … Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.048 sec … Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.364 sec Results : Tests run: 10, Failures: 0, Errors: 0, Skipped: 0 ------------------------------------------------------------------------ BUILD SUCCESS but the Test Results window shows only the two test cases from UrlAnnotatorTest. [1] https://github.com/jglick/jenkins/commit/5c0d9cd60f341b9fb853be14e758fafab3f18523
Changeset: 8a5f44e27c89 Author: Theofanis Oikonomou <theofanis@netbeans.org> Date: 2013-11-21 12:22 Message:
Changeset: 5abb65271023 Author: Theofanis Oikonomou <theofanis@netbeans.org> Date: 2013-11-21 16:38 Message: - additional fix to use maven api
Integrated into 'main-silver', will be available in build *201311230002* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress) Changeset: http://hg.netbeans.org/main-silver/rev/5abb65271023 User: Theofanis Oikonomou <theofanis@netbeans.org> Log: - additional fix to use maven api Task #224442 - Not all test results displayed when running Surefire in parallel
Well now in 20140317-eacabc97e7bc all the results *are* displayed, but only after the entire Maven test run has completed—there is no incremental display.
(In reply to Jesse Glick from comment #4) > Well now in 20140317-eacabc97e7bc all the results *are* displayed, but only > after the entire Maven test run has completed—there is no incremental > display. Correct me if I am wrong, but I think this is due to the fact that surefire is dumbing output after all tests are finished, when run in parallel mode. So until all tests are done the output-listener is not notified and thus not updating the UI. Not much can be done in this case in nb side.
(In reply to Theofanis Oikonomou from comment #5) > I think this is due to the fact that surefire > is dum[p]ing output after all tests are finished, when run in parallel mode. Not true. Using maven-surefire-plugin:2.17:test, Maven shows output as suites finish: Running Test1 Running Test2 Running Test3 Running Test4 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.482 sec - in Test2 Running Test5 Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.512 sec - in Test3 Running Test6 Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.782 sec - in Test1 Running Test7 … and target/surefire-reports/TEST-*.xml (as well as *.txt and *-output.txt) appear as soon as each suite is finished as well. Yet NetBeans (20140619-c7b326d0638f) just shows “Running…” until the very end, 5½ minutes later.
Changeset: b279011db3c0 Author: Theofanis Oikonomou <theofanis@netbeans.org> Date: 2014-06-27 20:15 Message:
It should be fixed now. I had some issues when using reuseForks=true and a forkCount value larger than one. The same output was shown in the output window. I think I handled this case effectively as to not show multiple nodes for the same test class. NOt sure if I missed something critical though. Any insight would be much appreciated. Thanks
Integrated into 'main-silver', will be available in build *201407010002* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress) Changeset: http://hg.netbeans.org/main-silver/rev/b279011db3c0 User: Theofanis Oikonomou <theofanis@netbeans.org> Log: Task #224442 - Not all test results displayed when running Surefire in parallel
20140818-f47eef37f759 test results are not displayed at all even when running a single test case, never mind parallel tests. The Test Results window opens but just says > No tests executed.(0.0 s) CoS, github.com/jenkinsci/jenkins/test/src/test/java/**/*Test.java.
Changeset: 36170197fc52 Author: Theofanis Oikonomou <theofanis@netbeans.org> Date: 2014-08-21 18:05 Message:
reproducible in latest build. Should be fixed now. Jirko can this make it in 8.0.1? Thanks
No, it's too late for 8.0.1. I am sorry. The fix will be available in NetBeans 8.1.
As a serious regression against NetBeans 8.0 this must be fixed in 8.0.1 timeframe. Increasing priority to reflect showstopper status.
Backported to release801: http://hg.netbeans.org/releases/rev/bf8eac8b4a82
Bug reproduced in: Product Version: NetBeans IDE 8.0.1 (Build 201408212300) Java: 1.7.0_67; Java HotSpot(TM) 64-Bit Server VM 24.65-b04 Runtime: Java(TM) SE Runtime Environment 1.7.0_67-b01 System: Linux version 3.13.0-24-generic running on amd64; UTF-8; en_US (nb)
Returning correct TM. Sorry for spamming.
Glad I reported that! Will recheck once this gets into main-silver.
Integrated into 'main-silver', will be available in build *201408230001* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress) Changeset: http://hg.netbeans.org/main-silver/rev/36170197fc52 User: Theofanis Oikonomou <theofanis@netbeans.org> Log: Task #224442 - Not all test results displayed when running Surefire in parallel
Integrated into 'releases/release801', will be available in build *201408222300* or newer. Wait for official and publicly available build. Changeset: http://hg.netbeans.org/releases/rev/bf8eac8b4a82 User: Theofanis Oikonomou <theofanis@netbeans.org> Log: Task #224442 - Not all test results displayed when running Surefire in parallel
Product Version: NetBeans IDE 8.0.1 (Build 201408222300) Java: 1.8.0_20; Java HotSpot(TM) 64-Bit Server VM 25.20-b23 Runtime: Java(TM) SE Runtime Environment 1.8.0_20-b31 System: Linux version 3.13.0-24-generic running on amd64; UTF-8; en_US (nb) Works like a charm. Test results window now displays errors correctly and updates itself incrementally if tests are run in parallel. Verified.
Finally working smoothly in 20140825-9a94e8cb336b, thanks!