oodt-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cameron Goodale (JIRA)" <j...@apache.org>
Subject [jira] [Created] (OODT-659) CommonsNetFtpProtocol.ls() method is causing unnecessary traffic
Date Fri, 08 Nov 2013 22:16:17 GMT
Cameron Goodale created OODT-659:

             Summary: CommonsNetFtpProtocol.ls() method is causing unnecessary traffic 
                 Key: OODT-659
                 URL: https://issues.apache.org/jira/browse/OODT-659
             Project: OODT
          Issue Type: Bug
          Components: push pull framework
    Affects Versions: 0.6
         Environment: *nix
            Reporter: Cameron Goodale
            Assignee: Cameron Goodale
             Fix For: 0.7

While trying to download files from an FTP server with 6400+ files on it pushpull would crash
with a 421 Error from the FTP server.

After a lot of research and testing we found that the code was calling pwd() for each file
when building up the list within the ls() method.

In the case of trying to scan a directory with a large number of files, this can make the
FTP server drop the connection due to the large number of request.

We moved the call to pwd outside of the loop, and everything works great.  We are able to
download the files easily now.

This message was sent by Atlassian JIRA

View raw message