hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manjunath Hegde <hegma...@gmail.com>
Subject OOM error and then system hangs
Date Sun, 15 Dec 2013 10:48:59 GMT
Hi,
   I am just trying to run wordcount job on 128KB file. First it failed
with java space error. Then I have allocated around 2GB space for child
JVMs. Now the system just hangs and have to restart the machine.

1. I am running ubuntu 13, 4GB RAM.
2. Datanodes reside on 2 virtual machines in virtualbox, both 1GB RAM and
ubuntu server(latest)


Another problem is i am getting beloe exception in nodemanager log.

2013-12-15 15:52:03,216 FATAL
org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting
NodeManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
signal from Resourcemanager ,Registration of NodeManager failed, Message
from ResourceManager: NodeManager from  master-01 doesn't satisfy minimum
allocations, Sending SHUTDOWN signal to the NodeManager.
        at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:181)
        at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
        at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:199)
        at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:339)
        at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:386)
Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
Message from ResourceManager: NodeManager from  master-01 doesn't satisfy
minimum allocations, Sending SHUTDOWN signal to the NodeManager.
        at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:246)
        at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:175)
        ... 6 more
2013-12-15 15:52:03,219 INFO
org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG:


An idea??

Thanks,
Manjunath

Mime
View raw message