This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.

Bug 166962 - "Scanning project" never ends
Summary: "Scanning project" never ends
Status: RESOLVED FIXED
Alias: None
Product: editor
Classification: Unclassified
Component: Parsing & Indexing (show other bugs)
Version: 6.x
Hardware: PC All
: P2 blocker with 1 vote (vote)
Assignee: Vitezslav Stejskal
URL:
Keywords: RANDOM
Depends on:
Blocks:
 
Reported: 2009-06-12 06:59 UTC by frankioski
Modified: 2009-09-11 08:02 UTC (History)
5 users (show)

See Also:
Issue Type: DEFECT
Exception Reporter:


Attachments
messages.log (120.66 KB, text/plain)
2009-06-12 06:59 UTC, frankioski
Details
Screen cap showing scanning project after 10 mins. after start up (120.22 KB, image/png)
2009-06-12 07:01 UTC, frankioski
Details
messages.log with the suggested switch. This time it took 3 mins. (1.12 MB, text/plain)
2009-06-23 19:20 UTC, frankioski
Details
Another messages.log (1.34 MB, text/plain)
2009-06-25 18:50 UTC, frankioski
Details
messages.log from new installation of 6.7rc3. Started IDE at 2:02; scanning stopped at 2:25. Inconsistent. (1.56 MB, text/plain)
2009-06-25 22:28 UTC, frankioski
Details
messages.log for 6.7rc3 (3.49 MB, text/plain)
2009-06-25 23:11 UTC, frankioski
Details
messages.log for 6.7rc3 after scan finally completes after 30 minutes. (3.54 MB, text/plain)
2009-06-25 23:20 UTC, frankioski
Details
messages.log for 6.7 release (not RC); started at 11:40 and scanning stopped at 12:04 (24 mins) (153.08 KB, text/plain)
2009-06-30 20:06 UTC, frankioski
Details
Here it is again: 17 minutes to scan. WTH?? (252.03 KB, text/plain)
2009-07-21 00:32 UTC, frankioski
Details
thread-dump (generated by jstack) (17.92 KB, text/plain)
2009-07-22 10:48 UTC, Marian Petras
Details

Note You need to log in before you can comment on or make changes to this bug.
Description frankioski 2009-06-12 06:59:19 UTC
Start up 6.7rc2. Scanning project continues forever.
Comment 1 frankioski 2009-06-12 06:59:44 UTC
Created attachment 83482 [details]
messages.log
Comment 2 frankioski 2009-06-12 07:01:11 UTC
Created attachment 83483 [details]
Screen cap showing scanning project after 10 mins. after start up
Comment 3 Vitezslav Stejskal 2009-06-15 12:58:30 UTC
Could you please start the IDE with -J-Dorg.netbeans.modules.parsing.impl.indexing.RepositoryUpdater.level=FINE and
attach here the messages.log again. The switch turns on logging of indexing activity. Thanks
Comment 4 frankioski 2009-06-23 19:20:43 UTC
Created attachment 83954 [details]
messages.log with the suggested switch. This time it took 3 mins.
Comment 5 Vitezslav Stejskal 2009-06-24 16:00:51 UTC
Thanks for the log file. It shows:

Complete indexing of 603 binary roots took: 21452 ms
Complete indexing of 119 source roots took: 93485 ms

which suggests that the indexing finished in approx. 2 minutes. The log file also shows that the classpath roots have
already been scanned (probably in the previous IDE session) and so the scanning only did the up-to-date check. After the
initial scan I don't see any further activity in the log file. Is the IDE really scanning? Is the log file corresponding
to the situation that you reported? Thanks
Comment 6 frankioski 2009-06-25 18:50:02 UTC
Created attachment 84023 [details]
Another messages.log
Comment 7 frankioski 2009-06-25 18:52:18 UTC
This time:

Complete indexing of 636 binary roots took: 25217 ms
Complete indexing of 157 source roots took: 159968 ms

Altogether, from starting of IDE to end of scanning (the progress bar disappearing), was about 6 mins.
Comment 8 frankioski 2009-06-25 22:28:51 UTC
Created attachment 84033 [details]
messages.log from new installation of 6.7rc3. Started IDE at 2:02; scanning stopped at 2:25. Inconsistent.
Comment 9 frankioski 2009-06-25 23:10:17 UTC
Restarted 6.7rc3 after encountering bug 167681 and scanning projects hasn't stopped after 25 minutes. Started at 2:43,
the scanning is still going at 3:08. I am unable to attach debugger (JPDA) with the scan going, and I do not see a
button to stop the scan. Raising priority to P2.
Comment 10 frankioski 2009-06-25 23:11:47 UTC
Created attachment 84038 [details]
messages.log for 6.7rc3
Comment 11 frankioski 2009-06-25 23:17:02 UTC
Scanning finally finishes at 3:13. This is extremely frustrating.
Comment 12 frankioski 2009-06-25 23:20:04 UTC
Created attachment 84039 [details]
messages.log for 6.7rc3 after scan finally completes after 30 minutes.
Comment 13 Vitezslav Stejskal 2009-06-30 10:39:14 UTC
Complete indexing of 635 binary roots took: 12221 ms
Complete indexing of 72 source roots took: 1650360 ms

Totaling to approx 28 minutes. I'm not sure why source roots indexing took so long.
Comment 14 frankioski 2009-06-30 20:06:48 UTC
Created attachment 84208 [details]
messages.log for 6.7 release (not RC); started at 11:40 and scanning stopped at 12:04 (24 mins)
Comment 15 frankioski 2009-07-01 19:01:10 UTC
FYI, my environment:

AMD Athlon 64 X2 Dual Core Processor 5200+, 2.59 GHz, 3.00 GB RAM, 139 GB HD with 98.4 GB free.
Windows XP Pro with SP3.
Comment 16 frankioski 2009-07-21 00:32:26 UTC
Created attachment 84957 [details]
Here it is again: 17 minutes to scan. WTH??
Comment 17 Marian Petras 2009-07-22 10:48:11 UTC
I confirm this bug.

Reproduced (several times) in NetBeans 6.8 dev.

It took 19 minutes to finish projects scanning after IDE startup.
This is a terrible bug that happens several times a week and NB 6.8 must not have this bug in order to be released -
hence I raise the priority to P1.

The profiler reports that some 92% of time was consumed by method Throwable.getStackTrace().

I will attach a typical thread-dump that I get during scanning.

--
NetBeans IDE Dev (Build 090722) (#aad0b72b6a5c)
JDK 6u14, 64-bit, server VM
Linux (Debian Lenny), 64-bit, Intel CPU (Core 2 Extreme - quad-core @ 3.0 GHz)
Comment 18 Marian Petras 2009-07-22 10:48:57 UTC
Created attachment 85057 [details]
thread-dump (generated by jstack)
Comment 19 Marian Petras 2009-07-22 10:59:25 UTC
This long scan happened after I updated by IDE to a new development build (built locally).
But after next update, the scan took just a few seconds. So this bug seems to be random.
Comment 20 David Strupl 2009-07-22 12:19:00 UTC
Marian, please create new report (give it P1 if you wish). This can be (and most probably is) something different than
whan Frank is reporting.

Marian has apisupport project while Frank has web and plain java project if I am not mistaken. Marian, please attach
more thread dumps - we would like to check whether it always ends in apisupport code. Also please run with the following
system property set: -J-Dorg.netbeans.modules.parsing.impl.indexing.RepositoryUpdater.level=FINE

Frank, could you possibly try working with your projects in a 6.8 development builds and check whether the problem is
still there. Please note that the dev builds are not suitable for real work, just for testing new version of NetBeans.
Please grab a copy of 6.8 build here (if you want to help of course):
http://bits.netbeans.org/download/trunk/nightly/latest/
Comment 21 David Strupl 2009-07-23 13:08:28 UTC
Mariane, what have you reported is being filed right now by Vita as #169040.
Comment 22 Vitezslav Stejskal 2009-09-11 08:02:53 UTC
Marian's problem was reported as issue #169040 and AFAIK it's already fixed. Frank, please use 6.8 dev build or the
upcoming beta, if it's still slow for you please run the IDE with
-J-Dorg.netbeans.modules.parsing.impl.indexing.RepositoryUpdater.level=FINE and attach here new log files. Thanks