This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.

Bug 76817 - Adding many files to project is too slow
Summary: Adding many files to project is too slow
Status: RESOLVED WORKSFORME
Alias: None
Product: cnd
Classification: Unclassified
Component: Project (show other bugs)
Version: 5.x
Hardware: All All
: P3 blocker (vote)
Assignee: Thomas Preisler
URL:
Keywords: PERFORMANCE, USABILITY
: 88069 (view as bug list)
Depends on:
Blocks:
 
Reported: 2006-05-24 15:43 UTC by _ gordonp
Modified: 2008-07-31 15:41 UTC (History)
1 user (show)

See Also:
Issue Type: DEFECT
Exception Reporter:


Attachments
Thread dump (14.37 KB, text/plain)
2006-10-31 00:04 UTC, Vladimir Kvashin
Details
Thread dump (a couple of minutes after starting adding files) (14.55 KB, text/plain)
2006-10-31 00:05 UTC, Vladimir Kvashin
Details

Note You need to log in before you can comment on or make changes to this bug.
Description _ gordonp 2006-05-24 15:43:41 UTC
From email from Dieter Ruppert from Siemens:

> [...] some more specific import mechanism would be very useful too (a
> list with relevant files, for example). This import is very slow
> (more than five minutes for about 2000 files), and I think this
> might be faster with a list of files which can be prepared 
> up front (we have a make target which prepares such a list).
Comment 1 Thomas Preisler 2006-05-24 15:49:26 UTC
I may be able to speed it up a bit, but in any case, we should have a progress
bar indicating how long time it is going to take.
Comment 2 Thomas Preisler 2006-06-02 06:20:28 UTC
Fixed.
Comment 3 Thomas Preisler 2006-06-02 06:22:09 UTC
marked fixed by mistake
Comment 4 Thomas Preisler 2006-10-26 16:20:51 UTC
See also http://www.netbeans.org/issues/show_bug.cgi?id=88069
Comment 5 Thomas Preisler 2006-10-30 02:06:52 UTC
*** Issue 88069 has been marked as a duplicate of this issue. ***
Comment 6 Vladimir Kvashin 2006-10-31 00:03:33 UTC
Though items aren't added to project in UI thread anymore, UI is still slow when
a lot of files are added to the project. Adding really big amount of files (I
tried to add about 2500) takes several minutes. I'm attachihg several thread
dumps, that were taken while files were being added to the project; hope they
will help.
Comment 7 Vladimir Kvashin 2006-10-31 00:04:26 UTC
Created attachment 35656 [details]
Thread dump
Comment 8 Vladimir Kvashin 2006-10-31 00:05:31 UTC
Created attachment 35657 [details]
Thread dump (a couple of minutes after starting adding files)
Comment 9 Thomas Preisler 2006-11-02 06:07:44 UTC
Radim Kubacki wrote:
AsynchronousInstantiatingIterator can be helpfull here and with
ProgressInstantiatingIterator you can even display progress (in trunk only).
Comment 10 soldatov 2006-11-08 14:05:20 UTC
I raised status because IDE hangs about 30 seconds when I am adding ~500 files
(it is not big project) into project. I think 'Add Folder' operation should not
hangs IDE more then 5-10 seconds for big projects.

Steps:
1) Create C/C++ project
2) Call 'Add Existing items from Folders...' menu item and select folder with
DDD source files
==> IDE hang on about 30 seconds
Comment 11 Vladimir Voskresensky 2006-11-08 14:29:23 UTC
I agree. And when trying to add MySQL sources it still blockes EQ and not
responsible for several minutes.
Comment 12 Thomas Preisler 2006-11-14 12:01:50 UTC
There may be a problem in the code that causes some performance issues. 

In any case, we should implement the same solution as the class browser. It
shows an hour glass when opening a node giving the right visual feedback.
Comment 13 Thomas Preisler 2006-11-14 12:38:57 UTC
This issue was escalated because of another performance issue with projects
where it takes too long to open a node in large projects. The original issue
(76817) is about adding files to a project takes too long. I have opened a new
issue:
89289 opening node in project view takes too long for large projec
for the second performance problem as a p2.

I think the original issue (76817) has been fixed for most use cases. We still
need some sort of progress bar in the wizard but this is not a p2 so I will
downgrade this issue to p3.

Comment 14 Jesse Grodnik 2007-04-18 19:23:28 UTC
Need to re-measure performance for 'large application', and if response is more
than 5-10 seconds to add progress bar. Defect downgraded to P3 since the
original issue has been addressed.
Comment 15 Alexander Pepin 2008-07-31 15:41:11 UTC
It seems that now it's not an issue any more. Now adding DDD sources takes 2-3 seconds.