Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 63E36C792 for ; Fri, 21 Jun 2013 01:48:03 +0000 (UTC) Received: (qmail 85324 invoked by uid 500); 21 Jun 2013 01:47:58 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 85230 invoked by uid 500); 21 Jun 2013 01:47:58 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Delivered-To: moderator for user@hadoop.apache.org Received: (qmail 90630 invoked by uid 99); 20 Jun 2013 08:23:38 -0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yankunhadoop@gmail.com designates 209.85.216.194 as permitted sender) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=3ObE0ZrxtNh0wQjJTl7kI+3BghsnOrdRHmkHEQa74rE=; b=vRBih0Fd6JBa5cFohlCZH6Kh602/MnnG2YHSxfa2ODg3rr4cSdAxHKckrNBVTKK8o4 kySiZnMG0ynu0zp6TECXRcrteRtlg+2Wr3fxI6lh6j/uf5SplMpwX4whpt/Y81B61eud VSbaE3pYJDVYnBqnWcvvKZ72TupPqPmlsMw7jOhkwyMJfFHeEOd1S/hh9D5w7XxbBcbu p/TqZ6OdYtE0VxUj6UM0IZp9L6kheCPga+oGbb1nNReyZ2SuhJg7W8mZ83DlV3tbNlLN Y4W9UqmqED7unXRa3MQkdF87o9EwWhwzedbxQeN2QxpW/C9OySRU13RQ6AL+amCos+lP Rx+A== MIME-Version: 1.0 X-Received: by 10.224.105.75 with SMTP id s11mr7830048qao.40.1371716591720; Thu, 20 Jun 2013 01:23:11 -0700 (PDT) Date: Thu, 20 Jun 2013 16:23:11 +0800 Message-ID: Subject: exec pi error From: =?GB2312?B?48bApQ==?= To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf3074d35c2e9e3904df91a89a X-Virus-Checked: Checked by ClamAV on apache.org --20cf3074d35c2e9e3904df91a89a Content-Type: text/plain; charset=GB2312 Content-Transfer-Encoding: quoted-printable Hi All=A3=BA I instation cdh4.3 thank you for help Error. As follows: [hadoop@hydra0001 mapreduce]$ hadoop jar hadoop-mapreduce-examples-2.0.0-cdh4.3.0.jar pi 10 10 Number of Maps =3D 10 Samples per Map =3D 10 13/06/20 16:06:38 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Wrote input for Map #0 Wrote input for Map #1 Wrote input for Map #2 Wrote input for Map #3 Wrote input for Map #4 Wrote input for Map #5 Wrote input for Map #6 Wrote input for Map #7 Wrote input for Map #8 Wrote input for Map #9 Starting Job 13/06/20 16:06:39 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited. 13/06/20 16:06:39 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started. 13/06/20 16:06:40 INFO input.FileInputFormat: Total input paths to process : 10 13/06/20 16:06:40 INFO mapreduce.JobSubmitter: number of splits:10 13/06/20 16:06:40 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar 13/06/20 16:06:40 WARN conf.Configuration: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative 13/06/20 16:06:40 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 13/06/20 16:06:40 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class 13/06/20 16:06:40 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative 13/06/20 16:06:40 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class 13/06/20 16:06:40 WARN conf.Configuration: mapred.job.name is deprecated. Instead, usemapreduce.job.name 13/06/20 16:06:40 WARN conf.Configuration: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class 13/06/20 16:06:40 WARN conf.Configuration: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class 13/06/20 16:06:40 WARN conf.Configuration: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir 13/06/20 16:06:40 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir 13/06/20 16:06:40 WARN conf.Configuration: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class 13/06/20 16:06:40 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps 13/06/20 16:06:40 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class 13/06/20 16:06:40 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir 13/06/20 16:06:40 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1371710258290_0003 13/06/20 16:06:40 INFO client.YarnClientImpl: Submitted application application_1371710258290_0003 to ResourceManager at hydra0001/ 192.5.1.50:8032 13/06/20 16:06:40 INFO mapreduce.Job: The url to track the job: http://hydra0001:8088/proxy/application_1371710258290_0003/ 13/06/20 16:06:40 INFO mapreduce.Job: Running job: job_1371710258290_0003 13/06/20 16:06:42 INFO mapreduce.Job: Job job_1371710258290_0003 running in uber mode : false 13/06/20 16:06:42 INFO mapreduce.Job: map 0% reduce 0% 13/06/20 16:06:42 INFO mapreduce.Job: Job job_1371710258290_0003 failed with state FAILED due to: Application application_1371710258290_0003 failed 1 times due to AM Container for appattempt_1371710258290_0003_000001 exited with exitCode: 1 due to: .Failing this attempt.. Failing the application. 13/06/20 16:06:42 INFO mapreduce.Job: Counters: 0 Job Finished in 3.185 seconds java.io.FileNotFoundException: File does not exist: hdfs://hydra0001/user/hadoop/QuasiMonteCarlo_TMP_3_141592654/out/reduce-out at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileS= ystem.java:824) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1704) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1728) at org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:= 314) at org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:351) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:360) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:5= 7) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImp= l.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDrive= r.java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:5= 7) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImp= l.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:208) the error logs as follows :Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/service/CompositeService at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:791) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.service.CompositeService at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 13 more yarn-env.sh export HADOOP_FREFIX=3D/opt/module/hadoop-2.0.0-cdh4.3.0 export HADOOP_COMMON_HOME=3D${HADOOP_FREFIX} export HADOOP_HDFS_HOME=3D${HADOOP_FREFIX} export PATH=3D$PATH:$HADOOP_FREFIX/bin export PATH=3D$PATH:$HADOOP_FREFIX/sbin export HADOOP_MAPRED_HOME=3D${HADOOP_FREFIX} export YARN_HOME=3D${HADOOP_FREFIX} export HADOOP_CONF_HOME=3D${HADOOP_FREFIX}/etc/hadoop export YARN_CONF_DIR=3D${HADOOP_FREFIX}/etc/hadoop export JAVA_HOME=3D/opt/module/jdk1.7.0_15 hadoop-env.sh export HADOOP_FREFIX=3D/opt/module/hadoop-2.0.0-cdh4.3.0 export HADOOP_COMMON_HOME=3D${HADOOP_FREFIX} export HADOOP_HDFS_HOME=3D${HADOOP_FREFIX} export PATH=3D$PATH:$HADOOP_FREFIX/bin export PATH=3D$PATH:$HADOOP_FREFIX/sbin export HADOOP_MAPRED_HOME=3D${HADOOP_FREFIX} export YARN_HOME=3D${HADOOP_FREFIX} export HADOOP_CONF_HOME=3D${HADOOP_FREFIX}/etc/hadoop export YARN_CONF_DIR=3D${HADOOP_FREFIX}/etc/hadoop export JAVA_HOME=3D/opt/module/jdk1.7.0_15 Hadoop env as follow: export HADOOP_FREFIX=3D/opt/module/hadoop-2.0.0-cdh4.3.0 export HADOOP_COMMON_HOME=3D${HADOOP_FREFIX} export HADOOP_HDFS_HOME=3D${HADOOP_FREFIX} export PATH=3D$PATH:$HADOOP_FREFIX/bin export PATH=3D$PATH:$HADOOP_FREFIX/sbin export HADOOP_MAPRED_HOME=3D${HADOOP_FREFIX} export YARN_HOME=3D${HADOOP_FREFIX} --20cf3074d35c2e9e3904df91a89a Content-Type: text/html; charset=GB2312 Content-Transfer-Encoding: quoted-printable
Hi All=A3=BA
I instation cdh4.3
thank you for help
Error. As follows:

[hado= op@hydra0001 mapreduce]$ hadoop jar hadoop-mapreduce-examples-2.0.0-cdh4.3.= 0.jar pi 10 10
Number of Maps  =3D 10
Samples per = Map =3D 10
13/06/20 16:06:38 WARN util.NativeCodeLoader: Unable to load native-ha= doop library for your platform... using builtin-java classes where applicab= le
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrot= e input for Map #4
Wrote input for Map #5
Wrote input f= or Map #6
Wrote input for Map #7
Wrote input for Map #8=
Wrote input for Map #9
Starting Job
13/06/20 16:06= :39 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.Yar= nClientImpl is inited.
13/06/20 16:06:39 INFO service.AbstractSer= vice: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
13/06/20 16:06:40 INFO input.FileInputFormat: Total input paths to pro= cess : 10
13/06/20 16:06:40 INFO mapreduce.JobSubmitter: number o= f splits:10
13/06/20 16:06:40 WARN conf.Configuration: mapred.jar= is deprecated. Instead, use mapreduce.job.jar
13/06/20 16:06:40 WARN conf.Configuration: mapred.map.tasks.speculativ= e.execution is deprecated. Instead, use mapreduce.map.speculative
13/06/20 16:06:40 WARN conf.Configuration: mapred.reduce.tasks is deprecat= ed. Instead, use mapreduce.job.reduces
13/06/20 16:06:40 WARN conf.Configuration: mapred.output.value.class i= s deprecated. Instead, use mapreduce.job.output.value.class
13/06= /20 16:06:40 WARN conf.Configuration: mapred.reduce.tasks.speculative.execu= tion is deprecated. Instead, use mapreduce.reduce.speculative
13/06/20 16:06:40 WARN conf.Configuration: mapreduce.map.class is depr= ecated. Instead, use mapreduce.job.map.class
13/06/20 16:06:40 WA= RN conf.Configuration: mapred.job.name is deprecated. Instead, usemapreduce.job.name
13/06/20 16:06:40 WARN conf.Configuration: mapreduce.reduce.class is d= eprecated. Instead, use mapreduce.job.reduce.class
13/06/20 16:06= :40 WARN conf.Configuration: mapreduce.inputformat.class is deprecated. Ins= tead, use mapreduce.job.inputformat.class
13/06/20 16:06:40 WARN conf.Configuration: mapred.input.dir is depreca= ted. Instead, use mapreduce.input.fileinputformat.inputdir
13/06/= 20 16:06:40 WARN conf.Configuration: mapred.output.dir is deprecated. Inste= ad, use mapreduce.output.fileoutputformat.outputdir
13/06/20 16:06:40 WARN conf.Configuration: mapreduce.outputformat.clas= s is deprecated. Instead, use mapreduce.job.outputformat.class
13= /06/20 16:06:40 WARN conf.Configuration: mapred.map.tasks is deprecated. In= stead, use mapreduce.job.maps
13/06/20 16:06:40 WARN conf.Configuration: mapred.output.key.class is = deprecated. Instead, use mapreduce.job.output.key.class
13/06/20 = 16:06:40 WARN conf.Configuration: mapred.working.dir is deprecated. Instead= , use mapreduce.job.working.dir
13/06/20 16:06:40 INFO mapreduce.JobSubmitter: Submitting tokens for j= ob: job_1371710258290_0003
13/06/20 16:06:40 INFO client.YarnClie= ntImpl: Submitted application application_1371710258290_0003 to ResourceMan= ager at hydra0001/192= .5.1.50:8032
13/06/20 16:06:40 INFO mapreduce.Job: The url to track the job: <= a href=3D"http://hydra0001:8088/proxy/application_1371710258290_0003/" targ= et=3D"_blank">http://hydra0001:8088/proxy/application_1371710258290_0003/
13/06/20 16:06:40 INFO mapreduce.Job: Running job: job_1371710258290_0= 003
13/06/20 16:06:42 INFO mapreduce.Job: Job job_1371710258290_0= 003 running in uber mode : false
13/06/20 16:06:42 INFO mapreduce= .Job:  map 0% reduce 0%
13/06/20 16:06:42 INFO mapreduce.Job: Job job_1371710258290_0003 faile= d with state FAILED due to: Application application_1371710258290_0003 fail= ed 1 times due to AM Container for appattempt_1371710258290_0003_000001 exi= ted with  exitCode: 1 due to: 
.Failing this attempt.. Failing the application.
13/06/20 16= :06:42 INFO mapreduce.Job: Counters: 0
Job Finished in 3.185 seco= nds
java.io.FileNotFoundException: File does not exist: hdfs://hy= dra0001/user/hadoop/QuasiMonteCarlo_TMP_3_141592654/out/reduce-out
        at org.apache.hadoop.hdfs.DistributedFileS= ystem.getFileStatus(DistributedFileSystem.java:824)
   =     at org.apache.hadoop.io.SequenceFile$Reader.<init>(Seq= uenceFile.java:1704)
        at org.apache.ha= doop.io.SequenceFile$Reader.<init>(SequenceFile.java:1728)
        at org.apache.hadoop.examples.QuasiMonteCa= rlo.estimatePi(QuasiMonteCarlo.java:314)
      &nb= sp; at org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:= 351)
        at org.apache.hadoop.util.ToolRu= nner.run(ToolRunner.java:70)
        at org.apache.hadoop.examples.QuasiMonteCa= rlo.main(QuasiMonteCarlo.java:360)
        at= sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
&nbs= p;       at sun.reflect.NativeMethodAccessorImpl.invoke(Nati= veMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImp= l.invoke(DelegatingMethodAccessorImpl.java:43)
    &nbs= p;   at java.lang.reflect.Method.invoke(Method.java:601)
&nb= sp;       at org.apache.hadoop.util.ProgramDriver$ProgramDes= cription.invoke(ProgramDriver.java:72)
        at org.apache.hadoop.util.ProgramDriver.dr= iver(ProgramDriver.java:144)
        at org.a= pache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
&= nbsp;       at sun.reflect.NativeMethodAccessorImpl.invoke0(= Native Method)
        at sun.reflect.NativeMethodAccessorImpl.in= voke(NativeMethodAccessorImpl.java:57)
       = ; at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess= orImpl.java:43)
        at java.lang.reflect.= Method.invoke(Method.java:601)
        at org.apache.hadoop.util.RunJar.main(RunJ= ar.java:208)


the error logs as follows

:Exception in thread "main" java.lang.NoClassDefFoundErr= or: org/apache/hadoop/yarn/service/CompositeService
	at java.lang.ClassLoader.defineClass1(Native Method)
	at java.lang.ClassLoader.defineClass(ClassLoader.java:791)
	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
	at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
	at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
	at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:482)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.service=
.CompositeService
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
	... 13 more

yarn= -env.sh
expor= t HADOOP_FREFIX=3D/opt/module/hadoop-2.0.0-cdh4.3.0 
export = HADOOP_COMMON_HOME=3D${HADOOP_FREFIX} 
export HADOOP_HDFS_HO= ME=3D${HADOOP_FREFIX} 
export PATH=3D$PATH:$HADOOP_FREFIX/bin 
export PATH=3D$= PATH:$HADOOP_FREFIX/sbin 
export HADOOP_MAPRED_HOME=3D${HADO= OP_FREFIX} 
export YARN_HOME=3D${HADOOP_FREFIX} 
<= div>export HADOOP_CONF_HOME=3D${HADOOP_FREFIX}/etc/hadoop 
export YARN_CONF_DIR=3D${HADOOP_FREFIX}/etc/hadoop 
exp= ort JAVA_HOME=3D/opt/module/jdk1.7.0_15

hadoop-env= .sh

export HADOOP_FREFIX=3D/opt/module/hadoop= -2.0.0-cdh4.3.0 
export HADOOP_COMMON_HOME=3D${HADOOP_FREFIX} 
export HA= DOOP_HDFS_HOME=3D${HADOOP_FREFIX} 
export PATH=3D$PATH:$HADO= OP_FREFIX/bin 
export PATH=3D$PATH:$HADOOP_FREFIX/sbin =
export HADOOP_MAPRED_HOME=3D${HADOOP_FREFIX} 
export YARN_HOME=3D${HADOOP_FREFIX} 
export HADOOP_CONF= _HOME=3D${HADOOP_FREFIX}/etc/hadoop 
export YARN_CONF_DIR=3D= ${HADOOP_FREFIX}/etc/hadoop 
export JAVA_HOME=3D/opt/module/= jdk1.7.0_15

Hadoop env as follow:

export H= ADOOP_FREFIX=3D/opt/module/hadoop-2.0.0-cdh4.3.0 
export HAD= OOP_COMMON_HOME=3D${HADOOP_FREFIX} 
export HADOOP_HDFS_HOME= =3D${HADOOP_FREFIX} 
export PATH=3D$PATH:$HADOOP_FREFIX/bin 
export PATH=3D$= PATH:$HADOOP_FREFIX/sbin 
export HADOOP_MAPRED_HOME=3D${HADO= OP_FREFIX} 
export YARN_HOME=3D${HADOOP_FREFIX}
<= /div>
--20cf3074d35c2e9e3904df91a89a--