hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wenyang xu <cutestsh...@gmail.com>
Subject hadoop profile problem
Date Mon, 02 Aug 2010 05:12:19 GMT
Hi, all.

I am trying to run the terasort to collect some profile information on
pseudo distributed mode of hadoop.
I found hadoop could achive it by define the mapred.task.profile in
conf/mapred-site.xml,
so i add some properties to the conf/mapred-site.xml like this:

------conf/mapred-site.xml------------------
....

<property>
<name>mapred.task.profile</name>
<value>true</value>
</property>

<property>
<name>keep.failed.task.files</name>
<value>true</value>
</property>

<property>
<name>keep.task.files.pattern</name>
<value>.*</value>
</property>
....

---------------------------------------------

When I run the terasort, exception is throwed out like this:

------Exception showed on the
screen----------------------------------------------------------

10/08/02 04:35:05 INFO mapred.JobClient: Running job: job_201008020434_0001
10/08/02 04:35:06 INFO mapred.JobClient:  map 0% reduce 0%
java.io.FileNotFoundException:
http://localhost:50060/tasklog?plaintext=true&taskid=attempt_201008020434_0001_m_000000_0&filter=profile
    at
org.apache.harmony.luni.internal.net.www.protocol.http.HttpURLConnectionImpl.getInputStream(HttpURLConnectionImpl.java:884)
    at
org.apache.hadoop.mapred.JobClient.downloadProfile(JobClient.java:1225)
    at
org.apache.hadoop.mapred.JobClient.monitorAndPrintJob(JobClient.java:1302)
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1251)
    at org.apache.hadoop.examples.terasort.TeraSort.run(TeraSort.java:248)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.hadoop.examples.terasort.TeraSort.main(TeraSort.java:257)
    at java.lang.reflect.AccessibleObject.invokeV(AccessibleObject.java:197)
    at java.lang.reflect.Method.invoke(Method.java:238)
    at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
    at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
    at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64)
    at java.lang.reflect.AccessibleObject.invokeV(AccessibleObject.java:197)
    at java.lang.reflect.Method.invoke(Method.java:238)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

---------------------------------------------
--------------------------------------------------

I will be very thankful If someone could give me any sugguestion to solve
this problem.

Look forward to any reply.

Best Regards,
Cindy

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message