Mailing-List: contact users-help@nifi.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@nifi.apache.org
Subject: Re: "Processor requires an upstream connection" for FetchS3Object?
To: users@nifi.apache.org
References: 
 <CAMpSqchqGxBkR30DKX8tN6Zk5CvUUN+Psu2por9sFmfvVAckoA@mail.gmail.com>
 <-635536004323127883@unknownmsgid>
 <CAMpSqcgxs7WWov7+XrPuiLSMf11w=syr=nHZeb1GSWpnO_32Tw@mail.gmail.com>
 <-6012962815755653676@unknownmsgid>
 <CAMpSqcjtoFhcQqiguSPB+pq=x0uqy=MspfQWngkH7b48zRAD8Q@mail.gmail.com>
 <CAPoTGOet+6_F+7FWE+LRzfDf88zNDRRXKwwb_kQTPS3kqLCueA@mail.gmail.com>
 <CALo_M1-FyMZnb3CoqH71Y3VvNNboWZ3hgNwbJPDyZH+kHg+0zg@mail.gmail.com>
 <5695C0A0.4030203@gmail.com>
 <CAMpSqcifhn-12MoC=5PBRcKdH=c-Lv3=E=-zK+MkPYBS0skFBw@mail.gmail.com>
From: Adam Lamar <adamonduty@gmail.com>
Message-ID: <5695C289.8030808@gmail.com>
Date: Tue, 12 Jan 2016 20:20:41 -0700
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0)
 Gecko/20100101 Thunderbird/38.5.1
MIME-Version: 1.0
In-Reply-To: 
 <CAMpSqcifhn-12MoC=5PBRcKdH=c-Lv3=E=-zK+MkPYBS0skFBw@mail.gmail.com>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit

Russell,

Sorry - I meant that I use the FetchS3Object processor, not ListS3. You 
can set the Object Key property with the name of the key you want to 
download. This property supports the expression language, so the object 
key can be sourced from each flowfile.

I'm unsure if there is a good template around, but I'd be willing to 
share my flow if that would be helpful.

Cheers,
Adam

On 1/12/16 8:14 PM, Russell Whitaker wrote:
> On Tue, Jan 12, 2016 at 7:12 PM, Adam Lamar <adamonduty@gmail.com> wrote:
>> On 1/12/16 8:04 PM, Bryan Bende wrote:
>>> In the case of FetchS3, there is definitely intent to have a ListS3, but
>>> there are still ways to use it with out that...
>>
>> To add to Bryan's comment, I use ListS3 in combination with GetSQS to fetch
>> objects as they are newly placed into an s3 bucket. For my use case, it
>> works great.
>>
> What "ListS3"? There's no ListS3* processor in the v0.4.1 distribution I have.
>
> R
>
>> There is also more discussion here:
>> https://issues.apache.org/jira/browse/NIFI-25 . In particular, see Mark
>> Payne's first comment. It sounds like the problem isn't so much implementing
>> the functionality, but some of the semantics around exactly what a ListS3
>> processor should do.
>>
>> Cheers,
>> Adam