nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bryan Bende <bbe...@gmail.com>
Subject Re: ListenTcpRecord
Date Thu, 05 Oct 2017 13:22:51 GMT
Have you tried using the template?

https://gist.githubusercontent.com/bbende/fa2bff34e721fef21453986336664cb2/raw/db658c64f75fec47785ab63920ee23582bf1492f/multi_line_log_processing.xml

If you import that it will give you the exact flow from my post and
all you have to do is start everything.

PutTCP is sending to ListenTCP, the connection coming out of PutTCP to
LogAttribute is for the failure relationship just to easily see if
anything fails.

-Bryan


On Thu, Oct 5, 2017 at 7:05 AM, Clay Teahouse <clayteahouse@gmail.com> wrote:
> Thanks Bryan, for the feedback.
>
> I don't seem to be able  to replicate the example in your blog. So, is the
> flow  GenerateFlowFile -> TCPPUT --> LogAttribute and ListenTCPRecord
> -->LogAttribute?  Both TCPPut and ListenTCPRecord  are sending data to
> LogAttribute?  Shouldn't ListenTCPRecord be receiving the data data? Also,
> I am not able to link ListenTCPRecord to any other processor.
>
> In any case, I tried to send logs to ListenTCPRecord using netcat and have
> ListenTCPRecord send the processed data to LogAttribute, but
> ListenTCPRecord doesn't seem to be listening (I don't see any activity on
> the processor). I'd appreciate if you let me what I am doing wrong.
>
> thanks
> Clay
>
> On Wed, Oct 4, 2017 at 9:14 AM, Bryan Bende <bbende@gmail.com> wrote:
>
>> Hello,
>>
>> I wrote a post that shows an example of using ListenTCPRecord with a
>> GrokReader to receive multi-line log messages. There is a link to a
>> template of the flow at the very end.
>>
>> You could easily change the example so that PutTCP is sending a single
>> JSON document, or an array of JSON documents, and ListenTCPRecord is
>> using a JsonTreeReader.
>>
>> We don't have a protobuf record reader so that currently isn't an option.
>>
>> Let us know if you have any other questions.
>>
>> -Bryan
>>
>> [1] https://bryanbende.com/development/2017/10/04/apache-
>> nifi-processing-multiline-logs
>>
>> On Wed, Oct 4, 2017 at 8:39 AM, Clay Teahouse <clayteahouse@gmail.com>
>> wrote:
>> > Hi All,
>> >
>> > Does anyone have an example of ListenTcpRecord processor in action, say
>> for
>> > example, with a json or protobuf reader? I am specifically wondering
>> about
>> > the record length/prefix.
>> >
>> > thanks
>> > Clay
>>

Mime
View raw message