nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Payne (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-673) Create ListSFTP, FetchSFTP Processors
Date Wed, 14 Oct 2015 16:54:06 GMT

    [ https://issues.apache.org/jira/browse/NIFI-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957254#comment-14957254
] 

Mark Payne commented on NIFI-673:
---------------------------------

[~aldrin] I uploaded a new version of the second patch. This should work better for you. I
made sure that the properties are consistent with what I expect should be there. Added the
<protocol>.remote.port attribute for the ListFileTransfer.

I left the property descriptors in both locations (FetchFileTransfer, SFTPTransfer), as some
have to do specifically with the abstract fetch processors; others are SFTP related. I could
copy the SFTP-related Property Descriptors into FetchSFTP, but then I think that's a bad idea
because we would have the same property descriptors repeated over and over again; this way
Property Names, validators, etc. are consistent between across SFTP processors.

I am not sure that I understood your comment about data duplication. Can you elaborate?

Thanks
-Mark

> Create ListSFTP, FetchSFTP Processors
> -------------------------------------
>
>                 Key: NIFI-673
>                 URL: https://issues.apache.org/jira/browse/NIFI-673
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>             Fix For: 0.4.0
>
>         Attachments: 0001-NIFI-673-Initial-implementation-of-ListSFTP-FetchSFT.patch,
0002-NIFI-673-Added-Completion-Strategy-to-FetchSFTP.patch
>
>
> This will allow us to pull a listing from a single primary node and then distribute the
work of pulling and processing the data across the cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message