This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.

Bug 269601 - Very slow manual upload
Summary: Very slow manual upload
Status: RESOLVED INCOMPLETE
Alias: None
Product: php
Classification: Unclassified
Component: FTP Support (show other bugs)
Version: 8.2
Hardware: PC Mac OS X
: P2 normal (vote)
Assignee: Tomas Mysik
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-01-19 10:55 UTC by kamilchojnacki
Modified: 2018-01-24 09:43 UTC (History)
3 users (show)

See Also:
Issue Type: DEFECT
Exception Reporter:


Attachments
options (6.97 KB, image/png)
2017-01-19 10:55 UTC, kamilchojnacki
Details
log file (79.37 KB, text/plain)
2017-04-22 20:04 UTC, kamilchojnacki
Details
FTP log (1.67 KB, text/plain)
2017-11-24 16:28 UTC, ClearChaos
Details

Note You need to log in before you can comment on or make changes to this bug.
Description kamilchojnacki 2017-01-19 10:55:18 UTC
Created attachment 163431 [details]
options

After i hit key combination to upload everything is fine until this moment:


Directory successfully changed.
LIST
Here comes the directory listing.
Directory send OK.


After that I must wait 2-5 minutes - then netbeans uploads the file. File has aproximately 1 KB.


Thank for Your time
Comment 1 kamilchojnacki 2017-01-19 11:52:50 UTC
Upload on save works perfect but not everywhere I can do this.
Comment 2 cokarmando 2017-02-28 16:00:44 UTC
Hello,

the same here, seems that is a problem with Mac and Sierra. Tested in 3 macs. Slow to download an to upload.
Comment 3 Tomas Mysik 2017-03-24 14:46:51 UTC
It is always a good idea to try more servers - does the problem occur for all of them? Also trying another FTP client (ideally written in Java) would be helpful.

Could you please start NetBeans from command line with [1], reproduce your problem and attach the IDE log [2] here? It would be also useful to attach a profiler snapshot [3] here - start profiling, slow-upload your file, stop profiling.

(In reply to cokarmando from comment #2)
> the same here, seems that is a problem with Mac and Sierra. Tested in 3
> macs. Slow to download an to upload.

The original report was for Windows so hard to say. Anyway, NetBeans uses Apache Commons Net [4] (version 3.3) so we could try to update it (the latest version is 3.6). I will have a look at it.

Thanks for your cooperation.
[1] -J-Dorg.netbeans.modules.php.project.connections.level=FINE
[2] http://wiki.netbeans.org/FaqLogMessagesFile
[3] http://wiki.netbeans.org/FaqProfileMeNow
[4] https://commons.apache.org/proper/commons-net/
Comment 4 Tomas Mysik 2017-03-27 06:08:33 UTC
Gues, please see my comment #3 and attach all the files requested. Meanwhile, I will try to update Apache Commons Net library.

Thanks.
Comment 5 Tomas Mysik 2017-03-27 08:38:58 UTC
(In reply to Tomas Mysik from comment #4)
> Meanwhile, I will try to update Apache Commons Net library.

See issue #270210.

Thanks.
Comment 6 Tomas Mysik 2017-03-27 08:59:09 UTC
Marking as INCOMPLETE and closing for now; please reopen but please attach all the requested files from comment #3.

Thanks.
Comment 7 Tomas Mysik 2017-04-04 07:26:43 UTC
BTW Commons Net just upgraded to its latest version, see isuue #270210. Please, wait a couple of days and then try a development version of NetBeans. Thanks.
Comment 8 kamilchojnacki 2017-04-05 07:03:08 UTC
Thank You Tomas. I'll try after the weekend. Could You explain what You mean in link [1] ? How should I run Netbeans to get log what You need?

Regards
Kamil
Comment 9 Tomas Mysik 2017-04-05 08:33:25 UTC
(In reply to kamilchojnacki from comment #8)
> Thank You Tomas. I'll try after the weekend.

Perfect, thank you.

> Could You explain what You mean
> in link [1] ? How should I run Netbeans to get log what You need?

The best way to do it is to run NB from command line (terminal) with the parameter [1] (e.g. "/my/path/to/netbeans[.exe] -J-Dorg.netbeans.modules.php.project.connections.level=FINE"). Then, as I wrote, reproduce your problem and attach the IDE log [2] to this issue.

Thanks for your cooperation.
[1] -J-Dorg.netbeans.modules.php.project.connections.level=FINE
[2] http://wiki.netbeans.org/FaqLogMessagesFile
Comment 10 kamilchojnacki 2017-04-07 11:28:48 UTC
Hi Tomas,
I figured it out what's the problem. After I add -J-Dorg.netbeans.modules.php.project.connections.level=FINE to command starting IDE I saw that Netbeans while I hit command to manually upload file to server was checking all the files in my projects ( over 200 k files). Because I had fragile data in my project and in my IDE log I create new project and I tried to reproduce problem with new, nearly empty project. The problem was not showing up ! :-)
So I delete netbeans project files from my big project and create new netbeans project from my files and it worked. So problem was in netbeans project config files and not in FTP module.

Thank You very my for Your help.

Kamil.
Comment 11 Tomas Mysik 2017-04-11 06:48:51 UTC
Thank you for letting us know. Great to hear that it works for you now.
Comment 12 kamilchojnacki 2017-04-19 07:41:01 UTC
Unfortunately still there is a problem. 

I got this logs:


FINE [org.netbeans.modules.php.project.connections.RemoteClient]: File SftpFile[name: XXXXXXX.php, parent directory: /path/to/project/] added to download queue
FINE [org.netbeans.modules.php.project.connections.transfer.RemoteTransferFile]: Absolute remote path "/path/to/project/XXXXX.php" -> remote path "XXXXX.php" (base directory "/path/to/project/")

I don't know why, after manual upload netbeans check files and adding to 'download queue'.
Comment 13 Tomas Mysik 2017-04-19 07:55:18 UTC
(In reply to kamilchojnacki from comment #12)
> FINE [org.netbeans.modules.php.project.connections.RemoteClient]: File
> SftpFile[name: XXXXXXX.php, parent directory: /path/to/project/] added to
> download queue
> FINE
> [org.netbeans.modules.php.project.connections.transfer.RemoteTransferFile]:
> Absolute remote path "/path/to/project/XXXXX.php" -> remote path "XXXXX.php"
> (base directory "/path/to/project/")

So, we are talking about SFTP? Why didn't you tell us sooner...? ;) Anyway, I need the whole IDE log to investigate what exactly happens. Also, verify that you are using Manual upload, not Upload-On-Save in your Project Properties.

Please, read _carefully_ comment #3 and provide all requested information and files otherwise we are not able to help you.

Thanks.
Comment 14 kamilchojnacki 2017-04-22 20:03:50 UTC
I've added log file.
Comment 15 kamilchojnacki 2017-04-22 20:04:22 UTC
Created attachment 164162 [details]
log file
Comment 16 Tomas Mysik 2017-04-24 09:12:20 UTC
Looking into the log file, I cannot see any problem. BTW you did more downloads than just one so it is unnecessarily verbose.

Please, in comment #3 there are more requests - does it happen also with some other server or just one? Is it possible to test it?

And - this is especially important - could you please also attach profiler snapshot (instructions can be found in the same comment) so we can see where the time is spent? Please, download just one file is possible.

Thank you for your cooperation.
Comment 17 ClearChaos 2017-11-24 16:28:41 UTC
Created attachment 165494 [details]
FTP log
Comment 18 ClearChaos 2017-11-24 16:31:18 UTC
I experience this problem on Netbeans 8.2 with larger projects.  But I don't experience it on Netbeans 8.02.  It can take 30+ seconds to upload a single small file.  Smaller projects don't seem to exhibit this issue.

As a test I've just uploaded a small file and the log window shows:

The real world time for the process to complete was 34 seconds.

I don't experience the same issue using other FTP clients (FileZilla).

Log file uploaded - the delay is directly after the "226 212 matches total" log entry.

I'm keen to help resolve this issue if I can.

Thanks.
Comment 19 Recif2 2018-01-06 14:03:39 UTC
Hi,

Having same issue here for month!... Still waiting to solve this problem as it is just annoying toi wait 30 seconds each time I make a modification on the file! :-((
Thinking about changing to an other program as I can't work that way anymore :-(
Comment 20 gogonk 2018-01-24 09:43:55 UTC
I confirm this issue. Very slow upload over SFTP.