This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.
As reported in bug 208442 org.netbeans.modules.ant.freeform.ArtifactProviderTest is failing on Linux with JDK7u4. Please evaluate ASAP, escalated by JDK team. We need to know whether it's a random failure, issue in test or problem in JDK. junit.framework.AssertionFailedError: have artifact for /home/tarle/work/comp-netbeans/btd/unit/data/example-projects/simple/build/simple-app.jar at junit.framework.Assert.fail(Assert.java:47) at junit.framework.Assert.assertTrue(Assert.java:20) at junit.framework.Assert.assertNotNull(Assert.java:214) at org.netbeans.modules.ant.freeform.ArtifactProviderTest.testBuildArtifact(ArtifactProviderTest.java:72)
Please evaluate ASAP, escalated by JDK team ... we need to know whether it's a random failure, issue in test or problem in JDK.
Reproducible with -Dtest-unit-sys-prop.NbTestCase.order=z-a, i.e. could fail randomly on any JDK 7+.
core-main #2f928ad3f622
By the way you should run tests with -Dtest-unit-sys-prop.NbTestCase.order=a-z if you want to eliminate a source of random failures on JDK 7+. (A future version of JUnit [1] will do something similar.) [1] https://github.com/KentBeck/junit/pull/293
Tons of tests fail when run in reverse method order that we have not cleaned up. Fixing them all would take a long time, and is not necessary for evaluating 7u4 regressions; just please test with a-z.
Integrated into 'main-golden', will be available in build *201203040400* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress) Changeset: http://hg.netbeans.org/main-golden/rev/2f928ad3f622 User: Jesse Glick <jglick@netbeans.org> Log: #208907: Evaluate org.netbeans.modules.ant.freeform.ArtifactProviderTest failure on Linux
If setting test-unit-sys-prop.NbTestCase.order doesn't change order defined in NbTestSuite or NbModuleSuite than it would be added to nbbuild/testdist/release.
(In reply to comment #7) > If setting test-unit-sys-prop.NbTestCase.order doesn't change order defined in > NbTestSuite or NbModuleSuite No, it does not change explicitly constructed suites. It only affects the order of testSomething methods in an implicit suite, which would otherwise be determined by the unpredictable results of Class.getDeclaredMethods.
So, I add it to nbbuild/testdist/release/build.xml. main#d9805300a2cb
Integrated into 'main-golden', will be available in build *201203071105* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress) Changeset: http://hg.netbeans.org/main-golden/rev/d9805300a2cb User: Jiri Skrivanek <jskrivanek@netbeans.org> Log: #208907 - Enforce order of test execution in an implicit suite to prevent failures caused by the unpredictable results of Class.getDeclaredMethods.