tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hitesh Shah (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-2636) MRInput and MultiMRInput should work for cases when there are 0 physical inputs
Date Tue, 28 Jul 2015 21:22:05 GMT

    [ https://issues.apache.org/jira/browse/TEZ-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645068#comment-14645068
] 

Hitesh Shah commented on TEZ-2636:
----------------------------------

Patch seems fine. 

General comment on MRInput ( unrelated to patch to some extent ): 
   - if the input is to be initialized via events, why is "getContext().inputIsReady();" being
invoked even before the input has received the event? Should it not be the case that isReady()
should only be done if input count is 0 or if input initialized from splits in dist cache?


> MRInput and MultiMRInput should work for cases when there are 0 physical inputs
> -------------------------------------------------------------------------------
>
>                 Key: TEZ-2636
>                 URL: https://issues.apache.org/jira/browse/TEZ-2636
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.4.0
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>         Attachments: TEZ-2636.1.txt
>
>
> It's possible that an Input is setup without any actual data. This is especially valid
when a task is processing multiple MRInputs. One side has data, but the other does not. In
such cases - we currently end up generating an error.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message