tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adrian Nicoara (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (TEZ-3983) VertexGroup ONE_TO_ONE edges do not produce the right graph
Date Fri, 24 Aug 2018 21:12:00 GMT

     [ https://issues.apache.org/jira/browse/TEZ-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Adrian Nicoara updated TEZ-3983:
--------------------------------
    Description: 
A VertexGroup is described to act as a union of multiple vertices.

Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is a union, then
the expectation is that the VertexGroup has 4 tasks. A ONE_TO_ONE edge, to a downstream vertex,
must then require that vertex to also have 4 tasks.

This is not the case, as evidenced by the [following test|https://github.com/apache/tez/blob/261bbdd5929d562758deb31085b565db8e92d6a2/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831].

Rather, what happens is that implementation (of unrolling the VertexGroup and directly creating
edges between the components of the VertexGroup and the downstream vertices) is presented
as the behavior.

  was:
A VertexGroup is described to act as a union of multiple vertices.

Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is a union, then
the expectation is that the VertexGroup has 4 tasks. A ONE_TO_ONE edge, to a downstream vertex,
must then require that vertex to also have 4 tasks.

This is not the case, as evidenced by the [following test|[https://github.com/apache/tez/blob/master/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831]].

Rather, what happens is that implementation (of unrolling the VertexGroup and directly creating
edges between the components of the VertexGroup and the downstream vertices) is presented
as the behavior.


> VertexGroup ONE_TO_ONE edges do not produce the right graph
> -----------------------------------------------------------
>
>                 Key: TEZ-3983
>                 URL: https://issues.apache.org/jira/browse/TEZ-3983
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Adrian Nicoara
>            Priority: Major
>
> A VertexGroup is described to act as a union of multiple vertices.
> Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is a union,
then the expectation is that the VertexGroup has 4 tasks. A ONE_TO_ONE edge, to a downstream
vertex, must then require that vertex to also have 4 tasks.
> This is not the case, as evidenced by the [following test|https://github.com/apache/tez/blob/261bbdd5929d562758deb31085b565db8e92d6a2/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831].
> Rather, what happens is that implementation (of unrolling the VertexGroup and directly
creating edges between the components of the VertexGroup and the downstream vertices) is presented
as the behavior.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message