nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-4375) Add bufferSize processor configuration to PutFTP
Date Mon, 11 Sep 2017 09:44:00 GMT

    [ https://issues.apache.org/jira/browse/NIFI-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160988#comment-16160988
] 

ASF GitHub Bot commented on NIFI-4375:
--------------------------------------

Github user ijokarumawak commented on the issue:

    https://github.com/apache/nifi/pull/2142
  
    Hi @glisignoli when I tested FetchFTP and GetFTP, I didn't find the same issue with PutFTP.
But looked at the commons-net source code again, I found the buffer size only affect with
ASCII data transfer mode. I was testing with binary mode.
    
    Thanks for the feedback. I will add the option to Get/FetchFTP processor, too. But leave
ListFTP as it is, because it does not transfer data so it does not use the buffer size option.


> Add bufferSize processor configuration to PutFTP
> ------------------------------------------------
>
>                 Key: NIFI-4375
>                 URL: https://issues.apache.org/jira/browse/NIFI-4375
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>            Reporter: Koji Kawamura
>            Assignee: Koji Kawamura
>
> PufFTP is reported that it is significantly slower to transfer the same file compared
with mput command.
> https://mail-archives.apache.org/mod_mbox/nifi-users/201709.mbox/%3CCA+WJ-+Kqr6_uJfvewOA6akmUDCEVse+7wNm6Xq9AHwFwVj_2kg@mail.gmail.com%3E
> It is less performant because it does not set buffer size of underlying org.apache.commons.net.ftp.FTPClient.
The default buffer size is only 1KB.
> Setting larger buffer size improves transfer rate.
> {code}
> To send 10MB file
> # BufferSize = 1KB (default)
> about 8 sec
> # BufferSize = 16KB
> about 300 ms
> {code}
> PutFTP should provide a property to specify a buffer size, and default value should be
bigger.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message