Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F2A0ED38A for ; Mon, 10 Sep 2012 22:53:33 +0000 (UTC) Received: (qmail 38882 invoked by uid 500); 10 Sep 2012 22:53:28 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 38798 invoked by uid 500); 10 Sep 2012 22:53:28 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 38789 invoked by uid 99); 10 Sep 2012 22:53:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Sep 2012 22:53:28 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.160.48] (HELO mail-pb0-f48.google.com) (209.85.160.48) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Sep 2012 22:53:23 +0000 Received: by pbbrq13 with SMTP id rq13so4032267pbb.35 for ; Mon, 10 Sep 2012 15:53:02 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=from:mime-version:content-type:subject:date:in-reply-to:to :references:message-id:x-mailer:x-gm-message-state; bh=d4FKPvVw/EU4Id4aEHqYsz1T586wBwxLnVPrtSfJsmM=; b=JmnwHvwt/hCI75xZ99M3lnXLttYu+/R0RG4mx9x4OiGbB2Qe8QoZulkUeueY2YcF8o kS4a8sdACTNJGnHEE68OcXEqDVX8tTRwpButTC2LURdIkfEdrDvPid16IkuhEdk1PumN xhuS5UtYdZc2GObMhv1+g+8TLSvGuf+NtQSuZXt3B2qu3jxgssaZwutIAHMZTbEbZJIJ Pt3ahuk/qnNowAn0BeTs7hHUErVLT10NRHaTUpm4XAVJxNWligNH9+L7sEBApvggR3+C H0qVyUkgF48xe74TGvBtGDq9hxvmT5Penxv7J5TK+qXV+QO2icQpPilFI7PyyUMoOnUX RWlw== Received: by 10.66.74.74 with SMTP id r10mr19258960pav.57.1347317582709; Mon, 10 Sep 2012 15:53:02 -0700 (PDT) Received: from [10.10.11.118] (host1.hortonworks.com. [70.35.59.2]) by mx.google.com with ESMTPS id pq7sm8782164pbb.25.2012.09.10.15.53.01 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 10 Sep 2012 15:53:02 -0700 (PDT) From: Vinod Kumar Vavilapalli Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: multipart/alternative; boundary="Apple-Mail=_4123C174-9EE2-4E31-AC17-DC282421D54D" Subject: Re: Can't run PI example on hadoop 0.23.1 Date: Mon, 10 Sep 2012 15:53:00 -0700 In-Reply-To: To: user@hadoop.apache.org References: Message-Id: X-Mailer: Apple Mail (2.1278) X-Gm-Message-State: ALoCoQlLJn0nFGXVukijkCbVCuMy9PyEiSIM8N4D2pFyqJNR8FfcxSvpqms0OAbLDAlTNNA3Pc4h X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_4123C174-9EE2-4E31-AC17-DC282421D54D Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=iso-8859-1 The AM corresponding to your MR job is failing continuously. Can you = check the container logs for your AM ? They should be in = ${yarn.nodemanager.log-dirs}/${application-id}/container_[0-9]*_0001_01_00= 0001/stderr Thanks, +Vinod On Sep 10, 2012, at 3:19 PM, Smarty Juice wrote: > Hello Champions, >=20 > I am a newbie to hadoop and trying to run first hadoop example : PI , = but I get the FIleNotFoundException, I do not know why its looking for = this file on hdfs, anyone pls help >=20 > Thank you, >=20 > >bin/hadoop jar = share/hadoop/mapreduce/hadoop-mapreduce-examples-0.23.1.jar pi = -Dmapreduce.clientfactory.class.name=3Dorg.apache.hadoop.mapred.YarnClient= Factory -libjars = share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-0.23.1.jar 16 = 10000 > 12/09/06 19:56:10 WARN conf.Configuration: = mapred.used.genericoptionsparser is deprecated. Instead, use = mapreduce.client.genericoptionsparser.used > Number of Maps =3D 16 > Samples per Map =3D 10000 > Wrote input for Map #0 > Wrote input for Map #1 > Wrote input for Map #2 > Wrote input for Map #3 > Wrote input for Map #4 > Wrote input for Map #5 > Wrote input for Map #6 > Wrote input for Map #7 > Wrote input for Map #8 > Wrote input for Map #9 > Wrote input for Map #10 > Wrote input for Map #11 > Wrote input for Map #12 > Wrote input for Map #13 > Wrote input for Map #14 > Wrote input for Map #15 > Starting Job > 12/09/06 19:56:22 WARN conf.Configuration: fs.default.name is = deprecated. Instead, use fs.defaultFS > 12/09/06 19:56:22 INFO input.FileInputFormat: Total input paths to = process : 16 > 12/09/06 19:56:23 INFO mapreduce.JobSubmitter: number of splits:16 > 12/09/06 19:56:25 INFO mapred.ResourceMgrDelegate: Submitted = application application_1346972652940_0002 to ResourceManager at = /0.0.0.0:8040 > 12/09/06 19:56:27 INFO mapreduce.Job: The url to track the job: = http://1.1.1.11:8088/proxy/application_1346972652940_0002/ > 12/09/06 19:56:27 INFO mapreduce.Job: Running job: = job_1346972652940_0002 > 12/09/06 19:56:55 INFO mapreduce.Job: Job job_1346972652940_0002 = running in uber mode : false > 12/09/06 19:56:55 INFO mapreduce.Job: map 0% reduce 0% > 12/09/06 19:56:56 INFO mapreduce.Job: Job job_1346972652940_0002 = failed with state FAILED due to: Application = application_1346972652940_0002 failed 1 times due to AM Container for = appattempt_1346972652940_0002_000001 exited with exitCode: 1 due to: > .Failing this attempt.. Failing the application. > 12/09/06 19:56:56 INFO mapreduce.Job: Counters: 0 > Job Finished in 35.048 seconds > java.io.FileNotFoundException: File does not exist: = hdfs://localhost:9000/user/XXXXX/QuasiMonteCarlo_TMP_3_141592654/out/reduc= e-out > at = org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFile= System.java:729) > at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1685) > at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1709) > at = org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java= :314) > at = org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:351) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69) > at = org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:360) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at = sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:= 39) > at = sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm= pl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at = org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriv= er.java:72) > at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) > at = org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at = sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:= 39) > at = sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm= pl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:200) >=20 >=20 --Apple-Mail=_4123C174-9EE2-4E31-AC17-DC282421D54D Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=iso-8859-1
Thanks,
+Vinod
On Sep 10, 2012, at 3:19 PM, Smarty Juice wrote:

Hello = Champions,

I am a newbie to hadoop and trying to run first hadoop = example : PI , but I get the FIleNotFoundException, I do not know why = its looking for this file on hdfs, anyone pls help

Thank = you,

>bin/hadoop jar=20 share/hadoop/mapreduce/hadoop-mapreduce-examples-0.23.1.jar pi=20 -Dmapreduce.clientfact= ory.class.name=3Dorg.apache.hadoop.mapred.YarnClientFactory -libjars=20 share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-0.23.1.jar 16=20= 10000
12/09/06 19:56:10 WARN conf.Configuration:=20 mapred.used.genericoptionsparser is deprecated. Instead, use=20 mapreduce.client.genericoptionsparser.used
Number of Maps =3D 16
Samples per Map =3D 10000
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
Wrote input for Map #10
Wrote input for Map #11
Wrote input for Map #12
Wrote input for Map #13
Wrote input for Map #14
Wrote input for Map #15
Starting Job
12/09/06 19:56:22 WARN conf.Configuration: fs.default.name is deprecated. = Instead, use fs.defaultFS
12/09/06 19:56:22 INFO input.FileInputFormat: Total input paths to = process : 16
12/09/06 19:56:23 INFO mapreduce.JobSubmitter: number of splits:16
12/09/06 19:56:25 INFO mapred.ResourceMgrDelegate: Submitted application application_1346972652940_0002 to ResourceManager at /0.0.0.0:8040
12/09/06 19:56:27 INFO mapreduce.Job: The url to track the job: http://1.1.1.11:8088/proxy/application_1346972652940_0002= /
12/09/06 19:56:27 INFO mapreduce.Job: Running job: = job_1346972652940_0002
12/09/06 19:56:55 INFO mapreduce.Job: Job job_1346972652940_0002 running = in uber mode : false
12/09/06 19:56:55 INFO mapreduce.Job: map 0% reduce 0%
12/09/06 19:56:56 INFO mapreduce.Job: Job job_1346972652940_0002 failed=20= with state FAILED due to: Application application_1346972652940_0002=20 failed 1 times due to AM Container for=20 appattempt_1346972652940_0002_000001 exited with exitCode: 1 due = to:
.Failing this attempt.. Failing the application.
12/09/06 19:56:56 INFO mapreduce.Job: Counters: 0
Job Finished in 35.048 seconds
java.io.FileNotFoundException: File does not exist:=20 hdfs://localhost:9000/user/XXXXX/QuasiMonteCarlo_TMP_3_1415= 92654/out/reduce-out
at = org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFile= System.java:729)
at = org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1685)
at = org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1709)
at = org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java= :314)
at = org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:351) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
at = org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:360)<= br> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native = Method)
at = sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:= 39)
at = sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm= pl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at = org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriv= er.java:72)
at = org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
at = org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native = Method)
at = sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:= 39)
at = sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm= pl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:200)



= --Apple-Mail=_4123C174-9EE2-4E31-AC17-DC282421D54D--