commons-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ralph Goers <ralph.go...@dslextreme.com>
Subject Re: [Commons-VFS] low performance on small files
Date Tue, 06 Apr 2010 21:30:31 GMT
Your analysis sounds right and is probably true on most of the protocols. If you have suggestions
on ways to improve this they would be most welcome.

Ralph

On Apr 6, 2010, at 9:36 AM, Kirill Safonov wrote:

> Hello community,
> 
> Commons VFS appears to be very inefficient when handling lots of small files
> via FTP. 
> 
> Indeed, to upload a single file (in my case it's
> /opt/lampp/htdocs/ftp_root/FtpJava/src/foo2/qqq.txt - sorry for such a long
> path) in does:
> 
> ------ refresh the file by calling 'LIST' at the parent directory (since
> it's was not resolved before)
> 
>> PWD 
> 257 "/opt/lampp/htdocs/ftp_root" 
>> CWD FtpJava/src/foo2 
> 250 Directory successfully changed. 
>> PORT 192,168,0,112,39,215 
> 200 PORT command successful. Consider using PASV. 
>> LIST 
> 150 Here comes the directory listing. 
> 226 Directory send OK. 
>> CWD /opt/lampp/htdocs/ftp_root 
> 250 Directory successfully changed. 
> 
> ------ transfer the file
> 
>> PORT 192,168,0,112,39,216 
> 200 PORT command successful. Consider using PASV. 
>> STOR FtpJava/src/foo2/qqq.txt 
> 150 Ok to send data. 
> 226 File receive OK. 
> 
> ------ refresh the file again by calling 'LIST' for the parent directory
> (FtpFileObject.onChange() calls FtpFileObject.getInfo(true))
> 
>> PWD 
> 257 "/opt/lampp/htdocs/ftp_root" 
>> CWD FtpJava/src/foo2 
> 250 Directory successfully changed. 
>> PORT 192,168,0,112,39,236 
> 200 PORT command successful. Consider using PASV. 
>> LIST 
> 150 Here comes the directory listing. 
> 226 Directory send OK. 
>> CWD /opt/lampp/htdocs/ftp_root 
> 250 Directory successfully changed.
> 
> This way lot of time is taken by refreshing siblings by issuing LIST for the
> same directory, while single refresh at the end of the group transfer is
> enough.
> 
> Did anyone experience this, did anyone tweak this behavior?
> 
> Thanks,
> Kirill
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> For additional commands, e-mail: user-help@commons.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org


Mime
View raw message