Mailing-List: contact users-help@nifi.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@nifi.apache.org
MIME-Version: 1.0
References: <FxdKuCJ4r6dA6yBuj8xgBxzsB_O3DzdpsYzxUt_cwPpXQNiGr4YCMPVacy4WfeUWm2TgCgA7epV-FvdOGiY1l_XQKzYn4qdsQbns-cPjvMo=@protonmail.com>
 <CAAtSHtdaPpf-1X0pGyg65EgZkP69bDOO686ABCBF-GBGsde7LA@mail.gmail.com>
In-Reply-To: <CAAtSHtdaPpf-1X0pGyg65EgZkP69bDOO686ABCBF-GBGsde7LA@mail.gmail.com>
From: Juan Sequeiros <hellojuan@gmail.com>
Date: Thu, 30 Nov 2017 03:00:26 +0000
Message-ID: <CAAtSHtdt_+qHbQt+VcOEo_5d0JDBL79hpEKCtnm3YLcw9Avmfw@mail.gmail.com>
Subject: Re: How to preserve original file name
To: tj5527 <tj5527@protonmail.com>, users@nifi.apache.org
Content-Type: multipart/alternative; boundary="94eb2c1a58d6d48105055f2a74ac"
archived-at: Thu, 30 Nov 2017 03:00:41 -0000

--94eb2c1a58d6d48105055f2a74ac
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi forgot to mention if posting to ListenHTTP
You must set =E2=80=9CHTTP Headers to receive as Attributes (Regex)=E2=80=
=9D to

.*

Or something more restrictive to include =E2=80=9Cfilename=E2=80=9D

Hope that helps.
On Wed, Nov 29, 2017 at 7:14 PM Juan Sequeiros <hellojuan@gmail.com> wrote:

> Hi,
>
> My experience has been that I need to pass it as a header with filename
> =E2=80=9Cattribute=E2=80=9D
>
>
> So =E2=80=94 header =E2=80=9Cfilename: AfileName=E2=80=9D
>
> Sorry on my mobile.
>
> On Wed, Nov 29, 2017 at 6:43 PM tj5527 <tj5527@protonmail.com> wrote:
>
>> I use the latest the nifi version (1.4.0) transforming xml to json. The
>> flow is done through
>>
>>     listen http -> transform xml -> put file
>>
>> Posting is done by executing
>>
>>     curl -X POST -d @/path/to/xml localhost:<port>/contentListener
>>
>> The entire process works perfectly with a single xml file. But when
>> trying to post large amount of xml files, I notice there exception throw=
n.
>> But the exception message doesn't show which file goes wrong, so I can't
>> find it. Therefore my question is how do I preserve the original file na=
me
>> so that when the exception is thrown I know which one goes wrong.
>>
>> What I can think of is creating another put file processor which links t=
o
>> transform xml processor when it fails. But I am not sure if the file nam=
e
>> would be preserved because I notice when it processes successfully (i.e.
>> successfully transformed xml's file name is renamed to something like
>> 52943123, which is nothing related to the original xml file name). Is th=
ere
>> any way to log the file name when transformation goes wrong?
>>
>> Thanks
>>
>>
>>
>>
>>
>>

--94eb2c1a58d6d48105055f2a74ac
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi forgot to mention if posting to ListenHTTP<br>You must set =E2=80=9CHTTP=
 Headers to receive as Attributes (Regex)=E2=80=9D to <br><br>.*<br><br>Or =
something more restrictive to include =E2=80=9Cfilename=E2=80=9D<br><br>Hop=
e that helps.<br><div class=3D"gmail_quote"><div dir=3D"ltr">On Wed, Nov 29=
, 2017 at 7:14 PM Juan Sequeiros &lt;<a href=3D"mailto:hellojuan@gmail.com"=
>hellojuan@gmail.com</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quo=
te" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"=
><div>Hi,<br><br><div dir=3D"auto">My experience has been that I need to pa=
ss it as a header with filename =E2=80=9Cattribute=E2=80=9D</div><br><br><d=
iv dir=3D"auto">So =E2=80=94 header =E2=80=9Cfilename: AfileName=E2=80=9D</=
div></div><div dir=3D"auto"><br></div><div dir=3D"auto">Sorry on my mobile.=
</div><div><br><div class=3D"gmail_quote"><div>On Wed, Nov 29, 2017 at 6:43=
 PM tj5527 &lt;<a href=3D"mailto:tj5527@protonmail.com" target=3D"_blank">t=
j5527@protonmail.com</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quo=
te" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"=
><div>I use the latest the nifi version (1.4.0) transforming xml to json. T=
he flow is done through <br></div><div><br></div><div>=C2=A0 =C2=A0 listen =
http -&gt; transform xml -&gt; put file<br></div><div><br></div><div>Postin=
g is done by executing <br></div><div>=C2=A0 =C2=A0 <br></div><div>=C2=A0 =
=C2=A0 curl -X POST -d @/path/to/xml localhost:&lt;port&gt;/contentListener=
=C2=A0=C2=A0<br></div><div><br></div><div>The entire process works perfectl=
y with a single xml file. But when trying to post large amount of xml files=
, I notice there exception thrown. But the exception message doesn&#39;t sh=
ow which file goes wrong, so I can&#39;t find it. Therefore my question is =
how do I preserve the original file name so that when the exception is thro=
wn I know which one goes wrong.=C2=A0<br></div><div><br></div><div>What I c=
an think of is creating another put file processor which links to transform=
 xml processor when it fails. But I am not sure if the file name would be p=
reserved because I notice when it processes successfully (i.e. successfully=
 transformed xml&#39;s file name is renamed to something like 52943123, whi=
ch is nothing related to the original xml file name). Is there any way to l=
og the file name when transformation goes wrong?<br></div><div><br></div><d=
iv>Thanks</div><div><br></div><div><br></div><div><br></div><div><br></div>=
<div><br></div></blockquote></div></div></blockquote></div>

--94eb2c1a58d6d48105055f2a74ac--