[72cat] Re: [news] Certification of 7.2 Release Candidate

  • From: Jiří Kovalský < >
  • To:
  • Subject: [72cat] Re: [news] Certification of 7.2 Release Candidate
  • Date: Sat, 16 Jun 2012 23:25:38 +0200

Good question indeed.

OK, let me clarify this. There is a big difference between sanity and full testing. Sanity tests should only take few hours (up to 4 hours maximum). If for example full testing of GUI Builder on one platform takes 16 hours, sanity testing must take only a fraction of it. If sanity test specification takes 16 hours, it's not a sanity test specification and needs a rewrite. The purpose of sanity testing is to only verify that recent fixes of high priority bugs didn't cause any regressions.

So, if you don't have sanity test specification or it almost equals full testing, don't hesitate to reduce it and only test basic functionality of the feature you are responsible for.

Thank you all for your help!
-Jirka

On 16.6.2012 20:01, Dhawal Saiya wrote:

I thought its the one described in Tribe list because of this:
" 3. Test functionality your tribe is responsible for [3] (or the
feature(s) you agreed to cover)"

[3] http://wiki.netbeans.org/NetCATTribes

I have one more question: In Sanity test do we have to go through all
the test specs or just main functionality?

--regards,
Dhawal Saiya




On Sat, Jun 16, 2012 at 8:59 PM, Yonathan Weldegebriel 
<
<mailto: >>
 wrote:

    Like Mark, I was also assuming the link from the google spreadsheet
    was the one to do.

    Its gonna be too hard to finish a 16hr test by Tuesday.


    -Yonathan

    On Jun 16, 2012, at 18:17, Mark Wilmoth 
<
    
<mailto: >>
 wrote:

    It's the same full test suite as before. Nooooo 14 hours! :)

    Mark

    ------------------------------------------------------------------------
    *From:* Goran Miskovic 
<
    
<mailto: >>
    *To:* 

 
<mailto: >
    *Sent:* Sat, June 16, 2012 10:10:25 AM
    *Subject:* [72cat] Re: [news] Certification of 7.2 Release Candidate

    Go to tribes page (see Jiri's email), find your tribe, find list
    of test specifications, find corresponding sanity test.

    On Sat, Jun 16, 2012 at 5:02 PM, Mark Wilmoth
    
<
 
<mailto: >>
 wrote:

        I saw that listed on the Google spreadsheet and I just assumed
        that was all we had to do. To be honest, I just jumped to
        conclusions I guess and never confirmed it. Gee I hope we
        don't need to go through another 14 hours of tests again.

        Mark

        
------------------------------------------------------------------------
        *From:* Dhawal Saiya 
<
        
<mailto: >>
        *To:* 

 
<mailto: >
        *Sent:* Sat, June 16, 2012 9:56:15 AM

        *Subject:* [72cat] Re: [news] Certification of 7.2 Release
        Candidate

        I did not come across this, Sorry Yonathan and Thanks Mark for
        pointing to the sanity test specs.

        --regards,
        Dhawal Saiya


        Blog : http://dhawal-saiya.blogspot.com

        Member of :
        * Netbeans User Group Nagpur : http://nugnagpur.wikispaces.com/
        * Java User Group Nagpur : http://www.jugnagpur.com
        <http://www.jugnagpur.com/>



        On Sat, Jun 16, 2012 at 8:18 PM, Mark Wilmoth
        
<
 
<mailto: >>
 wrote:

            I thought this was the sanity test?

            http://wiki.netbeans.org/TS_71_FormAndSupportSanity

            Mark

            
------------------------------------------------------------------------
            *From:* Dhawal Saiya 
<
            
<mailto: >>
            *To:* 

 
<mailto: >
            *Sent:* Sat, June 16, 2012 9:14:12 AM
            *Subject:* [72cat] Re: [news] Certification of 7.2 Release
            Candidate

            Hi Yonathan,

            The test specs are same, that were used for full
            functionality testing. Since you have opted for GUI
            Builder tribe, your specifications would be TS 72 form [1].

            [1] http://wiki.netbeans.org/TS_72_Form

            --regards,
            Dhawal Saiya


            Blog : http://dhawal-saiya.blogspot.com

            Member of :
            * Netbeans User Group Nagpur :
            http://nugnagpur.wikispaces.com/
            * Java User Group Nagpur : http://www.jugnagpur.com
            <http://www.jugnagpur.com/>



            On Sat, Jun 16, 2012 at 7:24 PM, Yonathan Weldegebriel
            
<
 
<mailto: >>
 wrote:

                Where exactly are these FCS test specs located?

                -Yonathan

                On Jun 15, 2012, at 22:26, Jiří Kovalský
                
<
                
<mailto: >>
 wrote:

                > I forgot to mention one thing. The build contains RC
                branding which means that exceptions no longer popup
                like in development builds but you only get a small
                red icon in the status bar if something exceptional
                happens.
                >
                > So, please watch the lower right corner periodically
                not to overlook some exception. If you spot it, click
                the icon to report the exception as you are surely
                used to. :)
                >
                > Thanks for your attention and have a nice and
                productive weekend!
                > -Jirka
                >
                > On 15.6.2012 21:18, Jiří Kovalský wrote:
                >
                >> Hello everyone,
                >>
                >> first of all I would like to thank all of you who
                participated in the
                >> full functionality testing that ended yesterday. It
                helped us very much
                >> indeed!
                >>
                >> According to the plan release72 branch has entered
                High Resistance mode
                >> and so we have built the first candidate [1] of
                NetBeans IDE 7.2 Release
                >> Candidate 1. This e-mail is to ask you for help
                with its certification.
                >> Please read below and follow the instructions.
                >>
                >> 1. Download native installer for your operating
                system and install the
                >> NetBeans IDE 7.2 RC1 candidate.
                >> 2. Make sure to use JDK 7 Update 5 [2].
                >> 3. Test functionality your tribe is responsible for
                [3] (or the
                >> feature(s) you agreed to cover) according to its
                sanity test specification.
                >> 4. If you find some problems, report them to
                Bugzilla as soon as you can.
                >> 5. After you are done, change your orange "X" to
                green "Go". If you
                >> report new P1 bug, change it to red "NoGo" and
                include bug ID.
                >> 6. Do this by Tuesday - _June 19th COB_ last timezone.
                >>
                >> [1]
                
http://bits.netbeans.org/netbeans/7.2/97wrr3/2012-06-14_18-30-58
                >> [2]
                
http://www.oracle.com/technetwork/java/javase/downloads/index.html
                >> [3] http://wiki.netbeans.org/NetCATTribes
                >>
                >> If you have any questions, don't hesitate to ask
                but please don't
                >> hesitate too long with the testing. We really need
                to know your Go/NoGo
                >> verdicts by Tuesday in order to publish this build
                to the whole NetBeans
                >> community.
                >>
                >> Finally, please don't share this 7.2 RC1 download
                URL off this team. And
                >> remember, this is a great way to earn some extra
                CAT points again. ;)
                >>
                >> Thank you all and happy testing!
                >>
                >> -Jirka






    --
    schkovich
    PHP Dojo <http://phpdojo.blogspot.com/>




[72cat] Re: [news] Certification of 7.2 Release Candidate

(continued)

[72cat] Re: [news] Certification of 7.2 Release Candidate

Yonathan Weldegebriel 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Dhawal Saiya 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Mark Wilmoth 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Dhawal Saiya 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Mark Wilmoth 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Goran Miskovic 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Mark Wilmoth 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Goran Miskovic 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Yonathan Weldegebriel 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Dhawal Saiya 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Jiří Kovalský 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Dhawal Saiya 06/17/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

管俊明 06/16/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Mario Pérez 06/18/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Dhawal Saiya 06/18/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Michel Graciano 06/18/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Vojtěch Sigler 06/19/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Duane Phinney 06/19/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Angelo Quaglia 06/19/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Glenn Holmer 06/19/2012

[72cat] Re: [news] Certification of 7.2 Release Candidate

Pranav Raulkar 06/19/2012

Project Features

About this Project

www was started in November 2009, is owned by jpirek, and has 21 members.
By use of this website, you agree to the NetBeans Policies and Terms of Use (revision 20131025.e7cbc9d). © 2013, Oracle Corporation and/or its affiliates. Sponsored by Oracle logo
 
 
Close
loading
Please Confirm
Close