hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Caesar Samsi <cmsa...@hotmail.com>
Subject Container errors running Terasort
Date Tue, 24 Nov 2015 02:16:08 GMT
Hi there,

I’m running Hadoop on a cluster of 4 Raspberry Pi’s for my project.

I am getting errors benchmarking the cluster using Terasort as shown below.

I’ve adjusted the memory & task numbers in mapred-site.xml as follows but still getting
the errors.

What can I do?

Thanks, Caesar.

   <property>
       <name>mapred.map.child.java.opts</name>
       <value>-Xmx180M</value>
   </property>
   <property>
       <name>mapred.reduce.child.java.opts</name>
       <value>-Xmx180M</value>
   </property>
   <property>
       <name>mapred.tasktracker.map.tasks.maximum</name>
       <value>2</value>
   </property>
   <property>
       <name>mapred.tasktracker.reduce.tasks.maximum</name>
       <value>2</value>
   </property>


==============
15/11/23 16:49:41 INFO mapreduce.Job: Task Id : attempt_1448325816071_0002_m_000051_0, Status
: FAILED

Container killed on request. Exit code is 137

Container exited with a non-zero exit code 137

Killed by external signal
==============

15/11/23 16:49:26 INFO mapreduce.Job: Task Id : attempt_1448325816071_0002_m_000003_0, Status
: FAILED

Exception from container-launch.

Container id: container_1448325816071_0002_01_000011

Exit code: 134

Exception message: /bin/bash: line 1:  6147 Aborted                 /usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/bin/java
-Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx180M -Djava.io.tmpdir=/usr/local/hadoop/data/nm-local-dir/usercache/hduser/appcache/application_1448325816071_0002/container_1448325816071_0002_01_000011/tmp
-Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011
-Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild
192.168.1.15 36720 attempt_1448325816071_0002_m_000003_0 11 > /usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stdout
2> /usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stderr

Stack trace: ExitCodeException exitCode=134: /bin/bash: line 1:  6147 Aborted            
    /usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN
-Xmx180M -Djava.io.tmpdir=/usr/local/hadoop/data/nm-local-dir/usercache/hduser/appcache/application_1448325816071_0002/container_1448325816071_0002_01_000011/tmp
-Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011
-Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild
192.168.1.15 36720 attempt_1448325816071_0002_m_000003_0 11 > /usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stdout
2> /usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stderr



	at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)

	at org.apache.hadoop.util.Shell.run(Shell.java:455)

	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)

	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)

	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)

	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)

	at java.util.concurrent.FutureTask.run(FutureTask.java:266)

	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

	at java.lang.Thread.run(Thread.java:744)





Container exited with a non-zero exit code 134

==============

15/11/23 16:49:43 INFO mapreduce.Job: Task Id : attempt_1448325816071_0002_m_000050_0, Status
: FAILED

Exception from container-launch.

Container id: container_1448325816071_0002_01_000005

Exit code: 1

Stack trace: ExitCodeException exitCode=1: 

	at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)

	at org.apache.hadoop.util.Shell.run(Shell.java:455)

	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)

	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)

	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)

	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)

	at java.util.concurrent.FutureTask.run(FutureTask.java:266)

	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

	at java.lang.Thread.run(Thread.java:744)


Container exited with a non-zero exit code 1
==============


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org


Mime
View raw message