The bug statistics for NB3.2 and NB3.3


PLEASE READ (at least) THIS: I wanted to learn from NetBeans 3.2 stabilization and try to predict how NB3.3 stabilization will be going. The first table shows numbers of bugs during NB3.2 stabilization and the second table shows our current bugs statistics (7/13-8/17). The numbers are not representing the same (NB3.2 counts only bugs reported for NB3.2 branch, but NB3.3 table counts all opened bugs).

1. NetBeans 3.2 Stabilization


The first table shows the stabilization of NetBeans 3.2. Before stabilization we had 592 bugs and when we released we had about 372 bugs. We resolved about 1300 bugs but discovered about 1150 new. According to Honza Chalupa not all bugs were included in this counts (because were reported for different branch). So the numbers do not represent total number of opened bugs during stabilization.

Week of stabilization
Total Bugs (P1/P2/P3) Week Changes: +New -Resolved
Total Changes (since Mar/9): +New -Resolved

592

-
1 (3/9-3/18)
N/A
N/A
N/A
2 (3/19-3/25)
N/A
N/A
N/A
3 (3/26-4/1)
571 (9/45/197)
+173 -157
+529 -508
4 (4/2-4/8)
386 (5/19/127)
+216 -388
+746 -884
5 (4/9-4/15)
392 (2/31/139)
+174 -179
+918 -1056
6 (4/16-4/22)
376 (1/28/130) +126 -146
+1036 -1190
7 (4/23-4/29)
372 (1/20/143)
+108 -123
+1141 -1304
Source: QA pages

2. NetBeans 3.3 development phase 

This table shows the numbers of bugs during last couple of weeks. Last date is 8/17 that is 2 weeks before NB3.3 feature freeze (=stabilization start). The numbers during last week started to be alarming. We have currently 1069 all opened bugs. Some weeks don't look good (e.g. +140 - 83 bugs! during last week)

NetBeans 3.3 before stabilization
Total Bugs (P1/P2/P3) Week Changes: +New -Resolved
7/13
894 (5/68/412)
+94 -81
7/20
903 (2/65/433)
+142 -128
7/27
954 (4/78/466)
+150 -106
8/3
989 (6/79/493)
+122 -113
8/10
997 (7/71/496)
+133 -131
8/17
1069 (9/72/573)
+140 -83
Source: QA pages

3. The observations

  • NetBeans 3.2 and NetBeans 3.3 are different. Different schedule, different features, etc. It is not so simple, just compare the numbers
  • It the NB3.2 table there are not all bugs involved (so the total opened bugs numbers could be +200 or something like that). NetBeans 3.3 numbers represent all currently opened bugs numbers.
  • It seems that:
    • We are able to resolve up to 150-200 bugs every week.
    • A lot of new bugs were discovered during NB 3.2 stabilization: 1300 resolved vs. 1150 new
    • It will probably be the same for NB3.3.
    • Sun's QA spent more or the same time on NB3.2 compared to NB3.3 during implementation phase (before feature freeze). So, we can't say that for NB3.3 we have more bugs discovered in advance - before feature freeze.

Comments please send to or to .

Not logged in. Log in, Register

By use of this website, you agree to the NetBeans Policies and Terms of Use. © 2016, Oracle Corporation and/or its affiliates. Sponsored by Oracle logo