tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adrian Nicoara (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3983) VertexGroup ONE_TO_ONE edges do not produce the right graph
Date Fri, 24 Aug 2018 21:07:00 GMT
Adrian Nicoara created TEZ-3983:
-----------------------------------

             Summary: VertexGroup ONE_TO_ONE edges do not produce the right graph
                 Key: TEZ-3983
                 URL: https://issues.apache.org/jira/browse/TEZ-3983
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Adrian Nicoara


A VertexGroup is described to act as a union of multiple vertices.

Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is a union, then
the expectation is that the VertexGroup has 4 tasks. A ONE_TO_ONE edge, to a downstream vertex,
must then require that vertex to also have 4 tasks.

This is not the case, as evidenced by the [following test|[https://github.com/apache/tez/blob/master/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831].] 

Rather, what happens is that implementation (of unrolling the VertexGroup and directly creating
edges between the components of the VertexGroup and the downstream vertices) is presented
as the behavior.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message