apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Priyanka Gugale <priya...@datatorrent.com>
Subject Re: [malhar-users] Re: How to find EOF - FileSplitter
Date Thu, 15 Oct 2015 10:32:40 GMT
>From FileMetadata object you know the number of blocks for each file.

So in "process" method of blockMetadata input port you can write your logic
to check if all blocks of particular file have been received. If yes your
file is read completely. You can emit some tuple from your tracking
operator to single EOF.

-Priyanka



On Thu, Oct 15, 2015 at 3:15 PM, Yogi Devendra <devendra@datatorrent.com>
wrote:

> Refer to this document to know about endwindow() functionality:
>
>
> https://www.datatorrent.com/docs/guides/OperatorDeveloperGuide.html#h.3znysh7
>
> ~ Yogi
>
> On Thu, Oct 15, 2015 at 2:55 PM, Chiru <chiru.vcj@gmail.com> wrote:
>
>> Hi,
>>
>> Iam writing the middle operator to track the EOF , In middle operator Im
>> getting the filemetadata from FileSplitter and BlockMetadatas from reader .
>> But i got stuck where should i write the comparision code and send EOF
>> signal.
>> And i want to know* endwindow* method functionality - like when this
>> method called in streaming .., can u brief on this?
>>
>> thanks -Chiru
>>
>>
>> On Friday, 9 October 2015 18:33:06 UTC+5:30, Chiru wrote:
>>
>>> Hi All,
>>>
>>> How i can find the entire file read when using the FileSplitter.I have
>>> to wait till the EOF then start processing.
>>>
>>> Please share sample code if possible.
>>>
>>> Thanks -Chiru
>>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Malhar" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to malhar-users+unsubscribe@googlegroups.com.
>> To post to this group, send email to malhar-users@googlegroups.com.
>> Visit this group at http://groups.google.com/group/malhar-users.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Malhar" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to malhar-users+unsubscribe@googlegroups.com.
> To post to this group, send email to malhar-users@googlegroups.com.
> Visit this group at http://groups.google.com/group/malhar-users.
> For more options, visit https://groups.google.com/d/optout.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message