hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HAMA-963) ArrayIndexOutOfBoundsException occurs when tasks are greater than splits
Date Fri, 07 Aug 2015 04:41:46 GMT

    [ https://issues.apache.org/jira/browse/HAMA-963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661295#comment-14661295
] 

Edward J. Yoon edited comment on HAMA-963 at 8/7/15 4:41 AM:
-------------------------------------------------------------

[~conquestor] Hi Minho, there're things must be considered. 

{code}
vargs.add(Long.toString(container.getId().getContainerId()));
{code}

Currently it seems task uses dynamic containerID. But, index of tasks must be sqeuntial number
from 0 for instance, task 0, task 1, task 2, ...  to support getPeerIndex() method.

{code}
  /**
   * @return the index of this peer from sorted array by taskId.
   */
  public int getPeerIndex();
{code}

and additionally, if RawSplit has partitionID and it's bigger than -1, taskID must match to
the partitionID. This is used for obtaining “nearby or related” data based on partitioner.


was (Author: udanax):
[~conquestor] Hi Minho, there're things must be considered. 

{code}
vargs.add(Long.toString(container.getId().getContainerId()));
{code}

Currently it seems task uses dynamic containerID. But, index of tasks must be sqeuntial number
from 0 for instance, task 0, task 1, task 2, ... and additionally, if RawSplit has partitionID
and it's bigger than -1, taskID must match to the partitionID. 

> ArrayIndexOutOfBoundsException occurs when tasks are greater than splits
> ------------------------------------------------------------------------
>
>                 Key: HAMA-963
>                 URL: https://issues.apache.org/jira/browse/HAMA-963
>             Project: Hama
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>            Reporter: Edward J. Yoon
>            Priority: Blocker
>             Fix For: 0.7.1
>
>
> ArrayIndexOutOfBoundsException occurs when the number of tasks are greater than the number
of splits at ApplicationMaster 950 line.
> {code}
>       assignedSplit = splits[taskid.id];
> {code}
> There are two options: Option1. launch additional tasks without input split.
> Option2. adjust the number of tasks as number of input splits.
> I prefer the option 1.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message