tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adrian Nicoara (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3983) VertexGroup ONE_TO_ONE edges do not produce the right graph
Date Fri, 24 Aug 2018 21:07:00 GMT
Adrian Nicoara created TEZ-3983:

             Summary: VertexGroup ONE_TO_ONE edges do not produce the right graph
                 Key: TEZ-3983
                 URL: https://issues.apache.org/jira/browse/TEZ-3983
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Adrian Nicoara

A VertexGroup is described to act as a union of multiple vertices.

Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is a union, then
the expectation is that the VertexGroup has 4 tasks. A ONE_TO_ONE edge, to a downstream vertex,
must then require that vertex to also have 4 tasks.

This is not the case, as evidenced by the [following test|[https://github.com/apache/tez/blob/master/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831].] 

Rather, what happens is that implementation (of unrolling the VertexGroup and directly creating
edges between the components of the VertexGroup and the downstream vertices) is presented
as the behavior.

This message was sent by Atlassian JIRA

View raw message