tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Badger (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-3792) RootInputVertexManager doesn't drain queued source task completed events
Date Tue, 11 Jul 2017 22:24:01 GMT

    [ https://issues.apache.org/jira/browse/TEZ-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083094#comment-16083094

Eric Badger commented on TEZ-3792:

I don't believe RootInputVertexManager is broken when slow start is disabled, but haven't
tested enough to back up that claim. [~jeagles] and I are testing to try and narrow down what
exactly the bug affects. I'm also working on a new test that tests this functionality in both
RootInput and ShuffleVertex so that we can make sure to preserve this functionality. The problem
is that the source tasks complete before the vertex is started and in RootInput there isn't
any code to act on these queued up events. Therefore, the number of source tasks completed
is always off and so tasks aren't scheduled. 

> RootInputVertexManager doesn't drain queued source task completed events
> ------------------------------------------------------------------------
>                 Key: TEZ-3792
>                 URL: https://issues.apache.org/jira/browse/TEZ-3792
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Eric Badger
>            Assignee: Eric Badger
>            Priority: Blocker
>         Attachments: TEZ-3792.001.patch
> This was broken in the addition of slow start to the RootInputVertexManager by TEZ-3274

This message was sent by Atlassian JIRA

View raw message