nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Kawamura (JIRA)" <j...@apache.org>
Subject [jira] [Created] (NIFI-4375) Add bufferSize processor configuration to PutFTP
Date Mon, 11 Sep 2017 05:47:00 GMT
Koji Kawamura created NIFI-4375:
-----------------------------------

             Summary: Add bufferSize processor configuration to PutFTP
                 Key: NIFI-4375
                 URL: https://issues.apache.org/jira/browse/NIFI-4375
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
            Reporter: Koji Kawamura
            Assignee: Koji Kawamura


PufFTP is reported that it is significantly slower to transfer the same file compared with
mput command.
https://mail-archives.apache.org/mod_mbox/nifi-users/201709.mbox/%3CCA+WJ-+Kqr6_uJfvewOA6akmUDCEVse+7wNm6Xq9AHwFwVj_2kg@mail.gmail.com%3E

It is less performant because it does not set buffer size of underlying org.apache.commons.net.ftp.FTPClient.
The default buffer size is only 1KB.
Setting larger buffer size improves transfer rate.

{code}
To send 10MB file

# BufferSize = 1KB (default)
about 8 sec

# BufferSize = 16KB
about 300 ms
{code}

PutFTP should provide a property to specify a buffer size, and default value should be bigger.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message