This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.

Bug 84903 - New test evaluation process
Summary: New test evaluation process
Status: CLOSED WONTFIX
Alias: None
Product: qa
Classification: Unclassified
Component: Tests (show other bugs)
Version: 5.x
Hardware: All All
: P3 blocker (vote)
Assignee: pzajac
URL:
Keywords:
Depends on: 84899
Blocks: 84882
  Show dependency tree
 
Reported: 2006-09-14 14:05 UTC by pzajac
Modified: 2011-06-10 09:14 UTC (History)
0 users

See Also:
Issue Type: ENHANCEMENT
Exception Reporter:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description pzajac 2006-09-14 14:05:47 UTC 
The test evaluation process doesn't work well. I would like to improve it.

Test are run daily from monday to friday by using test4u. Test4u contains
crontab with test run sheduling. The crontab is stored in xtestDB (issue
#84899). What is test run :
1) Download new build
2) Download test-distribution
3) Run test4u validation
4) Run commit validation from test-distribution
5) Run tests from test-distribution 
6) If everything success the results are published

Test evaluation do these tasks:
1) At 10.00 a.m (PRAGUE TIME):
 a)checks if all builds were run.
 b)sends emails with unevaluated tests
2) At 5 p.m. sends still not unevaluated tests yet

3)If the test are not evaluated till 12p.m. the test evaluation problem will be
escalated personally next working day.
Comment 1 Marian Mirilovic 2009-07-07 14:11:49 UTC 
too old -> wontfix