tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-1656) Grouping of splits should maintain the original ordering of splits within a group
Date Tue, 21 Oct 2014 22:08:33 GMT

    [ https://issues.apache.org/jira/browse/TEZ-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179208#comment-14179208
] 

Bikas Saha commented on TEZ-1656:
---------------------------------

Duh. Sorry. Did not refresh to see these comments. The config can remain the same. The internal
behavior can expand on it. The notional value of the config is what matters and that will
stay. We can look at that before release. 

> Grouping of splits should maintain the original ordering of splits within a group
> ---------------------------------------------------------------------------------
>
>                 Key: TEZ-1656
>                 URL: https://issues.apache.org/jira/browse/TEZ-1656
>             Project: Apache Tez
>          Issue Type: Task
>            Reporter: Bikas Saha
>            Assignee: Bikas Saha
>             Fix For: 0.5.2
>
>         Attachments: TEZ-1656.1.patch, TEZ-1656.2.patch, TEZ-1656.3.patch, TEZ-1656.4.patch,
TEZ-1656.5.commit.patch
>
>
> Sometimes the original splits may have an ordering (eg. splits from a sorted file). Maintaining
the ordering of splits inside a group maintains the sort order.
> The node level grouping maintains ordering. When collecting leftover groups for rack
level grouping, the ordering is lost in current code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message