hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-837) Add sort behaviour to runtime partitioner
Date Wed, 08 Jan 2014 04:32:50 GMT

    [ https://issues.apache.org/jira/browse/HAMA-837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865054#comment-13865054
] 

Edward J. Yoon commented on HAMA-837:
-------------------------------------

Found a bug in SemiClustering. In below case, deepcopy should be used.

{code}
- Vertex<Text, DoubleWritable, SemiClusterMessage> v = this;
+ Vertex<Text, DoubleWritable, SemiClusterMessage> v = this.deepCopy();
{code}

> Add sort behaviour to runtime partitioner
> -----------------------------------------
>
>                 Key: HAMA-837
>                 URL: https://issues.apache.org/jira/browse/HAMA-837
>             Project: Hama
>          Issue Type: Bug
>          Components: bsp core
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.7.0
>
>         Attachments: HAMA-837_v01.patch, HAMA-837_v02.patch
>
>
> If key is comparable and it need to be sorted by key of record, 
> {code}
>       if (outputPair.getKey() instanceof WritableComparable
>           && conf.getBoolean(Constants.PARTITION_SORT_BY_KEY, false)) {
> {code}
> each patitions should be sorted by key. In here, we can use external merge sort.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message