hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Minho Kim (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HAMA-963) ArrayIndexOutOfBoundsException occurs when tasks are greater than splits
Date Tue, 11 Aug 2015 07:16:49 GMT

     [ https://issues.apache.org/jira/browse/HAMA-963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Minho Kim resolved HAMA-963.
----------------------------
    Resolution: Fixed

This problem occurs since partition id is allocated to containerId which is allocated by YARN.
ContainerId of the worker tasks begin with 2 because the first containerId is allocated to
ApplicationMaster. It means that splits' array overflow occurs when you run Hama application
on YARN.
I fixed it!

Thanks.

> ArrayIndexOutOfBoundsException occurs when tasks are greater than splits
> ------------------------------------------------------------------------
>
>                 Key: HAMA-963
>                 URL: https://issues.apache.org/jira/browse/HAMA-963
>             Project: Hama
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>            Reporter: Edward J. Yoon
>            Assignee: Minho Kim
>            Priority: Blocker
>             Fix For: 0.7.1
>
>
> ArrayIndexOutOfBoundsException occurs when the number of tasks are greater than the number
of splits at ApplicationMaster 950 line.
> {code}
>       assignedSplit = splits[taskid.id];
> {code}
> There are two options: Option1. launch additional tasks without input split.
> Option2. adjust the number of tasks as number of input splits.
> I prefer the option 1.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message