hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-781) Setting partition split fails in local mode when file size is big and has a runtime partition (HashParitioner)
Date Thu, 25 Jul 2013 11:17:48 GMT

    [ https://issues.apache.org/jira/browse/HAMA-781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13719508#comment-13719508
] 

Edward J. Yoon commented on HAMA-781:
-------------------------------------

{code}
// (FileSplit) split).getPath().getName() == ratings1M.dat
String[] extractPartitionID = ((FileSplit) split).getPath().getName()
         .split("[-]"); // == [ratings1M.dat] , 1 elem
   rawSplit.setPartitionID(Integer.parseInt(extractPartitionID[1])); // out of bound
{code}

Above code should be executed only after partitioning is done. 

Anyway, I was thought it should be enabled by default - HAMA-751 - I'll reopen HAMA-751
                
> Setting partition split fails in local mode when file size is big and has a runtime partition
(HashParitioner)
> --------------------------------------------------------------------------------------------------------------
>
>                 Key: HAMA-781
>                 URL: https://issues.apache.org/jira/browse/HAMA-781
>             Project: Hama
>          Issue Type: Bug
>          Components: bsp core
>            Reporter: Ikhtiyor Ahmedov
>            Priority: Minor
>         Attachments: HAMA-781.patch
>
>
> when input partitioner set to HashPartitioner and file size is big in local mode; in
line 566 of BSPJobClient.java throws index out of bound exception.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message