commons-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kirill Safonov" <kirill.safo...@gmail.com>
Subject [Commons-VFS] low performance on small files
Date Tue, 06 Apr 2010 16:36:42 GMT
Hello community,

Commons VFS appears to be very inefficient when handling lots of small files
via FTP. 

Indeed, to upload a single file (in my case it's
/opt/lampp/htdocs/ftp_root/FtpJava/src/foo2/qqq.txt - sorry for such a long
path) in does:

------ refresh the file by calling 'LIST' at the parent directory (since
it's was not resolved before)

> PWD 
257 "/opt/lampp/htdocs/ftp_root" 
> CWD FtpJava/src/foo2 
250 Directory successfully changed. 
> PORT 192,168,0,112,39,215 
200 PORT command successful. Consider using PASV. 
> LIST 
150 Here comes the directory listing. 
226 Directory send OK. 
> CWD /opt/lampp/htdocs/ftp_root 
250 Directory successfully changed. 

------ transfer the file

> PORT 192,168,0,112,39,216 
200 PORT command successful. Consider using PASV. 
> STOR FtpJava/src/foo2/qqq.txt 
150 Ok to send data. 
226 File receive OK. 

------ refresh the file again by calling 'LIST' for the parent directory
(FtpFileObject.onChange() calls FtpFileObject.getInfo(true))

> PWD 
257 "/opt/lampp/htdocs/ftp_root" 
> CWD FtpJava/src/foo2 
250 Directory successfully changed. 
> PORT 192,168,0,112,39,236 
200 PORT command successful. Consider using PASV. 
> LIST 
150 Here comes the directory listing. 
226 Directory send OK. 
> CWD /opt/lampp/htdocs/ftp_root 
250 Directory successfully changed.

This way lot of time is taken by refreshing siblings by issuing LIST for the
same directory, while single refresh at the end of the group transfer is
enough.

Did anyone experience this, did anyone tweak this behavior?

Thanks,
 Kirill


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org


Mime
View raw message