nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Payne (JIRA)" <>
Subject [jira] [Commented] (NIFI-673) Create ListSFTP, FetchSFTP Processors
Date Wed, 14 Oct 2015 16:54:06 GMT


Mark Payne commented on NIFI-673:

[~aldrin] I uploaded a new version of the second patch. This should work better for you. I
made sure that the properties are consistent with what I expect should be there. Added the
<protocol>.remote.port attribute for the ListFileTransfer.

I left the property descriptors in both locations (FetchFileTransfer, SFTPTransfer), as some
have to do specifically with the abstract fetch processors; others are SFTP related. I could
copy the SFTP-related Property Descriptors into FetchSFTP, but then I think that's a bad idea
because we would have the same property descriptors repeated over and over again; this way
Property Names, validators, etc. are consistent between across SFTP processors.

I am not sure that I understood your comment about data duplication. Can you elaborate?


> Create ListSFTP, FetchSFTP Processors
> -------------------------------------
>                 Key: NIFI-673
>                 URL:
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>             Fix For: 0.4.0
>         Attachments: 0001-NIFI-673-Initial-implementation-of-ListSFTP-FetchSFT.patch,
> This will allow us to pull a listing from a single primary node and then distribute the
work of pulling and processing the data across the cluster.

This message was sent by Atlassian JIRA

View raw message