tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adrian Nicoara (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (TEZ-3983) VertexGroup ONE_TO_ONE edges do not produce the right graph
Date Fri, 24 Aug 2018 21:15:01 GMT

     [ https://issues.apache.org/jira/browse/TEZ-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Adrian Nicoara updated TEZ-3983:
    Attachment: 0001-TEZ-3893.-VertexGroup-ONE_TO_ONE-DAG-verify-patched-.patch

> VertexGroup ONE_TO_ONE edges do not produce the right graph
> -----------------------------------------------------------
>                 Key: TEZ-3983
>                 URL: https://issues.apache.org/jira/browse/TEZ-3983
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Adrian Nicoara
>            Priority: Major
>         Attachments: 0001-TEZ-3893.-VertexGroup-ONE_TO_ONE-DAG-verify-patched-.patch
> A VertexGroup is described to act as a union of multiple vertices.
> Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is a union,
then the expectation is that the VertexGroup has 4 tasks. A ONE_TO_ONE edge, to a downstream
vertex, must then require that vertex to also have 4 tasks.
> This is not the case, as evidenced by the [following test|https://github.com/apache/tez/blob/261bbdd5929d562758deb31085b565db8e92d6a2/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831].
> Rather, what happens is that implementation (of unrolling the VertexGroup and directly
creating edges between the components of the VertexGroup and the downstream vertices) is presented
as the behavior.

This message was sent by Atlassian JIRA

View raw message