62625 – Commit validation tests randomly fail

This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.

Bug 62625 - Commit validation tests randomly fail

Summary: Commit validation tests randomly fail

Status:	RESOLVED WORKSFORME

Alias:	None

Product:	www
Classification:	Unclassified
Component:	Builds & Repositories (show other bugs)
Version:	5.x
Hardware:	All All

Importance:	P1 blocker (vote)
Assignee:	Jiri Skrivanek

URL:
Keywords:

Depends on:
Blocks:

Reported:	2005-08-18 21:36 UTC by _ ludo
Modified:	2005-09-05 10:06 UTC (History)
CC List:	0 users

See Also:
Issue Type:	DEFECT
Exception Reporter:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.

Description _ ludo 2005-08-18 21:36:44 UTC

Commit validation tests randomly fail.
P1, show stopper for all the sub-sequent commits since it is impacting every one.

Otherwise, just remove the commit validation tests, since every body keeps check
in new code even after validation failure.

Comment 1 Jesse Glick 2005-08-19 02:26:47 UTC

Which tests in particular? Need to be able to assign this issue to someone; will
be ignored where it is.

Comment 2 _ ludo 2005-08-19 02:33:13 UTC

Last one was: etails for failed test/tests with errors:

testCVSLite:

      org.netbeans.junit.AssertionFailedErrorException: Dialog with title "Checkout"
	at org.netbeans.jellytools.JellyTestCase.runBare(JellyTestCase.java:143)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:118)
	at org.netbeans.junit.NbTestCase.run(NbTestCase.java:122)
	at junit.framework.TestSuite.runTest(TestSuite.java:208)
	at junit.framework.TestSuite.run(TestSuite.java:203)
	at org.netbeans.xtest.testrunner.JUnitTestRunner.runTests(JUnitTestRunner.java:167)
	at org.netbeans.xtest.testrunner.JUnitTestRunner.runTests(JUnitTestRunner.java:118)
	at org.netbeans.xtest.plugin.ide.MainWithExec.run(MainWithExec.java:211)
	at org.netbeans.xtest.plugin.ide.Main$2.run(Main.java:277)
	at java.lang.Thread.run(Thread.java:534)

Nested Exception is:
org.netbeans.jemmy.TimeoutExpiredException: Dialog with title "Checkout"
	at org.netbeans.jemmy.Waiter.waitAction(Waiter.java:140)
	at org.netbeans.jemmy.WindowWaiter.waitWindow(WindowWaiter.java:405)
	at org.netbeans.jemmy.WindowWaiter.waitWindow(WindowWaiter.java:195)
	at org.netbeans.jemmy.DialogWaiter.waitDialog(DialogWaiter.java:308)
	at
org.netbeans.jemmy.operators.JDialogOperator.waitJDialog(JDialogOperator.java:584)
	at org.netbeans.jemmy.operators.JDialogOperator.<init>(JDialogOperator.java:68)
	at org.netbeans.jemmy.operators.JDialogOperator.<init>(JDialogOperator.java:184)
	at org.netbeans.jemmy.operators.JDialogOperator.<init>(JDialogOperator.java:201)
	at org.netbeans.jemmy.operators.JDialogOperator.<init>(JDialogOperator.java:216)
	at org.netbeans.jellytools.NbDialogOperator.<init>(NbDialogOperator.java:45)
	at validation.IDEValidation.testCVSLite(IDEValidation.java:1090)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:324)
	at junit.framework.TestCase.runTest(TestCase.java:154)
	at org.netbeans.junit.NbTestCase.runBare(NbTestCase.java:135)
	at org.netbeans.jellytools.JellyTestCase.runBare(JellyTestCase.java:116)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:118)
	at org.netbeans.junit.NbTestCase.run(NbTestCase.java:122)
	at junit.framework.TestSuite.runTest(TestSuite.java:208)
	at junit.framework.TestSuite.run(TestSuite.java:203)
	at org.netbeans.xtest.testrunner.JUnitTestRunner.runTests(JUnitTestRunner.java:167)
	at org.netbeans.xtest.testrunner.JUnitTestRunner.runTests(JUnitTestRunner.java:118)
	at org.netbeans.xtest.plugin.ide.MainWithExec.run(MainWithExec.java:211)
	at org.netbeans.xtest.plugin.ide.Main$2.run(Main.java:277)
	at java.lang.Thread.run(Thread.java:534)

   

testProjectsView:

      org.netbeans.junit.AssertionFailedErrorException: Menu pushing: (JMenuItem
with text "Window", JMenuItem with text "Projects")
	at org.netbeans.jellytools.JellyTestCase.runBare(JellyTestCase.java:143)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:118)
	at org.netbeans.junit.NbTestCase.run(NbTestCase.java:122)
	at junit.framework.TestSuite.runTest(TestSuite.java:208)
	at junit.framework.TestSuite.run(TestSuite.java:203)
	at org.netbeans.xtest.testrunner.JUnitTestRunner.runTests(JUnitTestRunner.java:167)
	at org.netbeans.xtest.testrunner.JUnitTestRunner.runTests(JUnitTestRunner.java:118)
	at org.netbeans.xtest.plugin.ide.MainWithExec.run(MainWithExec.java:211)
	at org.netbeans.xtest.plugin.ide.Main$2.run(Main.java:277)
	at java.lang.Thread.run(Thread.java:534)

Nested Exception is:
org.netbeans.jemmy.TimeoutExpiredException: Menu pushing: (JMenuItem with text
"Window", JMenuItem with text "Projects")
	at org.netbeans.jemmy.Waiter.waitAction(Waiter.java:140)
	at org.netbeans.jemmy.ActionProducer.produceAction(ActionProducer.java:245)
	at org.netbeans.jemmy.operators.Operator.produceTimeRestricted(Operator.java:690)
	at org.netbeans.jemmy.operators.Operator.produceTimeRestricted(Operator.java:713)
	at
org.netbeans.jemmy.operators.JMenuBarOperator.pushMenu(JMenuBarOperator.java:214)
	at
org.netbeans.jemmy.operators.JMenuBarOperator.pushMenu(JMenuBarOperator.java:256)
	at
org.netbeans.jemmy.operators.JMenuBarOperator.pushMenu(JMenuBarOperator.java:322)
	at org.netbeans.jellytools.actions.Action.performMenu(Action.java:265)
	at org.netbeans.jellytools.actions.Action.perform(Action.java:171)
	at org.netbeans.jellytools.actions.Action.perform(Action.java:215)
	at org.netbeans.jellytools.ProjectsTabOperator.invoke(ProjectsTabOperator.java:60)
	at validation.IDEValidation.testProjectsView(IDEValidation.java:252)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:324)
	at junit.framework.TestCase.runTest(TestCase.java:154)
	at org.netbeans.junit.NbTestCase.runBare(NbTestCase.java:135)
	at org.netbeans.jellytools.JellyTestCase.runBare(JellyTestCase.java:116)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:118)
	at org.netbeans.junit.NbTestCase.run(NbTestCase.java:122)
	at junit.framework.TestSuite.runTest(TestSuite.java:208)
	at junit.framework.TestSuite.run(TestSuite.java:203)
	at org.netbeans.xtest.testrunner.JUnitTestRunner.runTests(JUnitTestRunner.java:167)
	at org.netbeans.xtest.testrunner.JUnitTestRunner.runTests(JUnitTestRunner.java:118)
	at org.netbeans.xtest.plugin.ide.MainWithExec.run(MainWithExec.java:211)
	at org.netbeans.xtest.plugin.ide.Main$2.run(Main.java:277)
	at java.lang.Thread.run(Thread.java:534)

   


Previous one was (2 or 3 times): 

testXML:

      java.lang.ClassCastException
	at
org.netbeans.modules.xml.text.folding.XmlFoldManager.updateFolds(XmlFoldManager.java:179)
	at
org.netbeans.modules.xml.text.folding.XmlFoldManager.access$300(XmlFoldManager.java:47)
	at
org.netbeans.modules.xml.text.folding.XmlFoldManager$1.run(XmlFoldManager.java:108)
	at org.openide.util.Task.run(Task.java:207)
	at org.openide.util.RequestProcessor$Task.run(RequestProcessor.java:469)
	at org.openide.util.RequestProcessor$Processor.run(RequestProcessor.java:870)

Comment 3 Jesse Glick 2005-08-19 04:09:58 UTC

Who knows. Failure messages indecipherable. Someone from QA should look at it, I
guess.

Comment 4 Jiri Skrivanek 2005-08-19 08:57:02 UTC

I don't agree that failures you mentioned were random. All problems were in IDE.

1) testCVSLite, testProjectsView in build 20050818-1341

http://www.netbeans.org/download/dev/buildlogs/continuous/20050818-1341/xtest_results/index.html

Fixed in IDE in next builds.

2) testXML in builds from 20050817-1948 to 20050818-0028 - 

http://www.netbeans.org/issues/show_bug.cgi?id=62536 (ClassCastException from
XmlFoldManager)

Comment 5 _ ludo 2005-08-22 01:51:21 UTC

Please, tell me why these commits
http://nbbuilder.czech.sun.com:8080/nbcbfiles/dev/logs/NetBeans-dev-20050821-2205_os_changelog.txt

fixed this failure...
http://nbbuilder.czech.sun.com:8080/nbcbfiles/dev/logs/20050821-2046/xtest_results/index.html

I do no see the relationship there...

Comment 6 Jiri Skrivanek 2005-08-29 11:14:09 UTC

The failure you mentioned was a race-condition in debugger:

http://www.netbeans.org/download/dev/buildlogs/continuous/20050821-2046/xtest_results/testrun_050821-231602/testbag_4/htmlresults/suites/TEST-validation.IDECommitValidation.html#validation.IDEValidation.testDebugging

It was filed as issue 59830 and finally fixed on August, 26-th:

http://www.netbeans.org/servlets/ReadMsg?list=broken_builds&msgNo=2963