hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Behroz Sikander (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-970) Exception can occur if the size of splits is bigger than numBSPTasks
Date Wed, 09 Dec 2015 16:56:10 GMT

    [ https://issues.apache.org/jira/browse/HAMA-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048969#comment-15048969
] 

Behroz Sikander commented on HAMA-970:
--------------------------------------

Actually my scenario was a little more complex, I have to increase/decrease the data and BSPTasks
for doing experimentation. So, I took your idea and instead of doing it manually, I wrote
a small class which takes all the parameters as input and divides the files and puts them
in HDFS. Path of those files is added as input to Hama job.

https://github.com/bsikander/EV-ADMM/blob/valley-filling-optimized/src/admm/PartitionInputData.java

> Exception can occur if the size of splits is bigger than numBSPTasks
> --------------------------------------------------------------------
>
>                 Key: HAMA-970
>                 URL: https://issues.apache.org/jira/browse/HAMA-970
>             Project: Hama
>          Issue Type: Bug
>          Components: bsp core
>    Affects Versions: 0.7.0
>            Reporter: JongYoon Lim
>            Priority: Trivial
>         Attachments: HAMA-970.patch
>
>
> In JonInProgress, it's possble to get Exception in initTasks(). 
> {code:java}
> this.tasks = new TaskInProgress[numBSPTasks];
> for (int i = 0; i < splits.length; i++) {
>   tasks[i] = new TaskInProgress(getJobID(), this.jobFile.toString(), splits[i], this.conf,
this, i);
> }
> {code}
> I'm not sure that *numBSPTask* is always bigger than *splits.length*. 
> So, I think it's better to use bigger value to assign the *tasks* array. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message