hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Minho Kim (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HAMA-848) Refactor YARN module for hadoop 2.x stable version
Date Mon, 02 Feb 2015 11:09:36 GMT

     [ https://issues.apache.org/jira/browse/HAMA-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Minho Kim updated HAMA-848:
---------------------------
    Attachment: HAMA_YARN04.patch

I think that token issue is still a problem.
The error log in Application Master stdout is as follows.
{code}
getContainerStatusesResponse : failed_requests { container_id { app_attempt_id { application_id
{ id: 76 cluster_timestamp: 1422512191908 } attemptId: 1 } id: 2 } exception { message: "Container
container_1422512191908_0076_01_000002 was recently stopped on node manager." trace: "org.apache.hadoop.yarn.exceptions.YarnException:
Container container_1422512191908_0076_01_000002 was recently stopped on node manager.\n\tat
org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:48)\n\tat org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.getContainerStatusInternal(ContainerManagerImpl.java:793)\n\tat
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.getContainerStatuses(ContainerManagerImpl.java:772)\n\tat
org.apache.hadoop.yarn.api.impl.pb.service.ContainerManagementProtocolPBServiceImpl.getContainerStatuses(ContainerManagementProtocolPBServiceImpl.java:89)\n\tat
org.apache.hadoop.yarn.proto.ContainerManagementProtocol$ContainerManagementProtocolService$2.callBlockingMethod(ContainerManagementProtocol.java:99)\n\tat
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)\n\tat
org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)\n\tat org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)\n\tat
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)\n\tat java.security.AccessController.doPrivileged(Native
Method)\n\tat javax.security.auth.Subject.doAs(Subject.java:415)\n\tat org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)\n\tat
org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)\n" class_name: "org.apache.hadoop.yarn.exceptions.YarnException"
} }
{code}

And a nodemanager's error log is here.
{code}
WARN  ipc.Client (Client.java:call(1388)) - interrupted waiting to send rpc request to server
java.lang.InterruptedException
    at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:400)
    at java.util.concurrent.FutureTask.get(FutureTask.java:187)
    at org.apache.hadoop.ipc.Client$Connection.sendRpcRequest(Client.java:1029)
    at org.apache.hadoop.ipc.Client.call(Client.java:1383)
    at org.apache.hadoop.ipc.Client.call(Client.java:1363)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
    at com.sun.proxy.$Proxy77.heartbeat(Unknown Source)
    at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.client.LocalizationProtocolPBClientImpl.heartbeat(LocalizationProtocolPBClientImpl.java:62)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.localizeFiles(ContainerLocalizer.java:255)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:169)
    at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:107)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:999)
2015-02-02 19:48:12,559 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:processHeartbeat(563))
- Unknown localizer with localizerId container_1422512191908_0076_01_000002 is sending heartbeat.
Ordering it to DIE
{code}


> Refactor YARN module for hadoop 2.x stable version
> --------------------------------------------------
>
>                 Key: HAMA-848
>                 URL: https://issues.apache.org/jira/browse/HAMA-848
>             Project: Hama
>          Issue Type: Improvement
>    Affects Versions: 0.7.0
>            Reporter: Edward J. Yoon
>            Assignee: Minho Kim
>              Labels: patch
>             Fix For: 0.7.0
>
>         Attachments: HAMA-HDFS2XBuild.Patch, HAMA-YARNDraft.patch, HAMA_YARN.patch, HAMA_YARN02.patch,
HAMA_YARN03.patch, HAMA_YARN04.patch
>
>
> Current yarn-module was implemented based on Hadoop 0.23.1 version. You'll need to use
the Hama RPC instead of Hadoop RPC.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message