Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 80CBAD430 for ; Fri, 24 May 2013 17:42:03 +0000 (UTC) Received: (qmail 37388 invoked by uid 500); 24 May 2013 17:41:58 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 37293 invoked by uid 500); 24 May 2013 17:41:57 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 37274 invoked by uid 99); 24 May 2013 17:41:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 May 2013 17:41:57 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jeetuyadav200890@gmail.com designates 209.85.215.48 as permitted sender) Received: from [209.85.215.48] (HELO mail-la0-f48.google.com) (209.85.215.48) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 May 2013 17:41:52 +0000 Received: by mail-la0-f48.google.com with SMTP id fs12so4706677lab.21 for ; Fri, 24 May 2013 10:41:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=gIb0kprkQLCfLgZv8s9lxv+3wA/BXsBFQHCE4izoOF4=; b=GISsmsJrL9a76JH4QtXloiy09laSMXE7iNY4Xk6++PD7jOOdubFXaOsCuJ73xh2FbN hVjxyeowYHyvVQ4RjxVIFi7XOIoG/wuH+DbyLjkYRB3rIksyyMXhWgMFPLQieufdG4Ou 4Wun2O8EWwKwxn14Y22pgqMh3fQhn1tBQjAH3Abkr/1eTCjPFbhFqILK5jfFbV/zRWWl NPAqHQBirapGeMUgI6RWhHhu9/T4/g/xhaZbvUtTRLjvw7nv3Kvpa22Wef/NkPOMWD+E vIx1ZurWm4bDZD3K98RLLcjJ1zjBfUXg4dovoJIEYszvO65ID9t1iZ5g7PVf9wvtvQM0 dfLA== MIME-Version: 1.0 X-Received: by 10.112.72.65 with SMTP id b1mr9297166lbv.36.1369417291164; Fri, 24 May 2013 10:41:31 -0700 (PDT) Received: by 10.112.5.136 with HTTP; Fri, 24 May 2013 10:41:31 -0700 (PDT) In-Reply-To: References: Date: Fri, 24 May 2013 23:11:31 +0530 Message-ID: Subject: Re: Error while using the Hadoop Streaming From: Jitendra Yadav To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c340c6306fb404dd7a4f07 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c340c6306fb404dd7a4f07 Content-Type: text/plain; charset=ISO-8859-1 Hi, I have run Michael's python map reduce example several times without any issue. I think this issue is related to your file path 'mapper.py'. you are using python binary? try this, hadoop jar /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/hadoop-streaming-1.1.2.jar \ -input /user/yyy/20417-8.txt \ -output /user/yyy/output \ -file /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/mapper.py \ -mapper /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/mapper.py \ -file /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/reducer.py \ -reducer /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/reducer.py Thanks~ On Fri, May 24, 2013 at 10:12 PM, Adamantios Corais < adamantios.corais@gmail.com> wrote: > I tried this nice example: > http://www.michael-noll.com/tutorials/writing-an-hadoop-mapreduce-program-in-python/ > > The python scripts work pretty fine from my laptop (through terminal), but > they don't when I execute them on the CDH3 (Pseudo-Distributed Mode). > > Any ideas? > > hadoop jar > /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/hadoop-streaming-1.1.2.jar > \ > -input /user/yyy/20417-8.txt \ > -output /user/yyy/output \ > -file /usr/bin/python > /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/mapper.py \ > -mapper /usr/bin/python > /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/mapper.py \ > -file /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/reducer.py \ > -reducer /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/reducer.py > > ----------------------- > > 2013-05-24 18:21:12,232 INFO org.apache.hadoop.util.NativeCodeLoader: > Loaded the native-hadoop library > 2013-05-24 18:21:12,569 INFO > org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating > symlink: > /var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/yyy/jobcache/job_201305160832_0020/jars/job.jar > <- > /var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/yyy/jobcache/job_201305160832_0020/attempt_201305160832_0020_m_000000_0/work/job.jar > 2013-05-24 18:21:12,586 INFO > org.apache.hadoop.filecache.TrackerDistributedCacheManager: Creating > symlink: > /var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/yyy/jobcache/job_201305160832_0020/jars/.job.jar.crc > <- > /var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/yyy/jobcache/job_201305160832_0020/attempt_201305160832_0020_m_000000_0/work/.job.jar.crc > 2013-05-24 18:21:12,717 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: > Initializing JVM Metrics with processName=MAP, sessionId= > 2013-05-24 18:21:13,062 INFO org.apache.hadoop.util.ProcessTree: setsid > exited with exit code 0 > 2013-05-24 18:21:13,087 INFO org.apache.hadoop.mapred.Task: Using > ResourceCalculatorPlugin : > org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1358f03 > 2013-05-24 18:21:13,452 WARN > org.apache.hadoop.io.compress.snappy.LoadSnappy: Snappy native library is > available > 2013-05-24 18:21:13,452 INFO > org.apache.hadoop.io.compress.snappy.LoadSnappy: Snappy native library > loaded > 2013-05-24 18:21:13,464 INFO org.apache.hadoop.mapred.MapTask: > numReduceTasks: 1 > 2013-05-24 18:21:13,477 INFO org.apache.hadoop.mapred.MapTask: io.sort.mb > = 100 > 2013-05-24 18:21:13,635 INFO org.apache.hadoop.mapred.MapTask: data buffer > = 79691776/99614720 > 2013-05-24 18:21:13,635 INFO org.apache.hadoop.mapred.MapTask: record > buffer = 262144/327680 > 2013-05-24 18:21:13,724 INFO org.mortbay.log: Logging to > org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via > org.mortbay.log.Slf4jLog > 2013-05-24 18:21:13,733 INFO org.apache.hadoop.streaming.PipeMapRed: > PipeMapRed exec [mapper.py] > 2013-05-24 18:21:13,783 ERROR org.apache.hadoop.streaming.PipeMapRed: > configuration exception > java.io.IOException: Cannot run program "mapper.py": java.io.IOException: > error=2, No such file or directory > at java.lang.ProcessBuilder.start(ProcessBuilder.java:460) > at > org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:214) > at org.apache.hadoop.streaming.PipeMapper.configure(PipeMapper.java:66) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) > at > org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) > at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) > at > org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:387) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325) > at org.apache.hadoop.mapred.Child$4.run(Child.java:266) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278) > at org.apache.hadoop.mapred.Child.main(Child.java:260) > Caused by: java.io.IOException: java.io.IOException: error=2, No such file > or directory > at java.lang.UNIXProcess.(UNIXProcess.java:148) > at java.lang.ProcessImpl.start(ProcessImpl.java:65) > at java.lang.ProcessBuilder.start(ProcessBuilder.java:453) > ... 24 more > 2013-05-24 18:21:13,869 INFO org.apache.hadoop.mapred.TaskLogsTruncater: > Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1 > 2013-05-24 18:21:13,871 WARN org.apache.hadoop.mapred.Child: Error running > child > java.lang.RuntimeException: Error in configuring object > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) > at > org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:387) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325) > at org.apache.hadoop.mapred.Child$4.run(Child.java:266) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278) > at org.apache.hadoop.mapred.Child.main(Child.java:260) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) > ... 9 more > Caused by: java.lang.RuntimeException: Error in configuring object > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) > at > org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) > at > org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) > at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34) > ... 14 more > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) > ... 17 more > Caused by: java.lang.RuntimeException: configuration exception > at > org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:230) > at org.apache.hadoop.streaming.PipeMapper.configure(PipeMapper.java:66) > ... 22 more > Caused by: java.io.IOException: Cannot run program "mapper.py": > java.io.IOException: error=2, No such file or directory > at java.lang.ProcessBuilder.start(ProcessBuilder.java:460) > at > org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:214) > ... 23 more > Caused by: java.io.IOException: java.io.IOException: error=2, No such file > or directory > at java.lang.UNIXProcess.(UNIXProcess.java:148) > at java.lang.ProcessImpl.start(ProcessImpl.java:65) > at java.lang.ProcessBuilder.start(ProcessBuilder.java:453) > ... 24 more > 2013-05-24 18:21:13,879 INFO org.apache.hadoop.mapred.Task: Runnning > cleanup for the task > --001a11c340c6306fb404dd7a4f07 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,
=A0
I have run Michael's python map reduce= example several times without any issue.
=A0
I think= =A0this issue is related to your file path 'mapper.py'.=A0 you are = using python binary?
=A0
try this,
=A0
h= adoop jar /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/hadoop-stream= ing-1.1.2.jar \
=A0-input /user/yyy/20417-8.txt \
-output /user/yyy/o= utput \
-file /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/mapper.py \
-m= apper /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/mapper.py \
= =A0-file /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/reducer.py \ -reducer /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/reducer.py
=A0
=A0
Thanks~

On Fri, May 24, 2013 at 10:12 PM, Adamantios Corais <adamantios.corais@gmail.com> wrote:
I tried this nice example: http://www.michael-noll.com/tutorials/writing-an-= hadoop-mapreduce-program-in-python/

The python scripts work pretty fine from my laptop (through terminal), = but they don't when I execute them on the CDH3 (Pseudo-Distributed Mode= ).

Any ideas?

hadoop jar /home/yyy/Dropbox/Private/xxx/Projec= ts/task_week_22/hadoop-streaming-1.1.2.jar \
-input /user/yyy/20417-8.txt \
-output /user/yyy/output \
-file /usr/= bin/python /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/mapper.py \<= br>-mapper /usr/bin/python /home/yyy/Dropbox/Private/xxx/Projects/task_week= _22/mapper.py \
-file /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/reducer.py \
-= reducer /home/yyy/Dropbox/Private/xxx/Projects/task_week_22/reducer.py
<= br>-----------------------

2013-05-24 18:21:12,232 INFO org.apache.h= adoop.util.NativeCodeLoader: Loaded the native-hadoop library
2013-05-24 18:21:12,569 INFO org.apache.hadoop.filecache.TrackerDistributed= CacheManager: Creating symlink: /var/lib/hadoop-0.20/cache/mapred/mapred/lo= cal/taskTracker/yyy/jobcache/job_201305160832_0020/jars/job.jar <- /var/= lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/yyy/jobcache/job_2013= 05160832_0020/attempt_201305160832_0020_m_000000_0/work/job.jar
2013-05-24 18:21:12,586 INFO org.apache.hadoop.filecache.TrackerDistributed= CacheManager: Creating symlink: /var/lib/hadoop-0.20/cache/mapred/mapred/lo= cal/taskTracker/yyy/jobcache/job_201305160832_0020/jars/.job.jar.crc <- = /var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/yyy/jobcache/job= _201305160832_0020/attempt_201305160832_0020_m_000000_0/work/.job.jar.crc 2013-05-24 18:21:12,717 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Init= ializing JVM Metrics with processName=3DMAP, sessionId=3D
2013-05-24 18:= 21:13,062 INFO org.apache.hadoop.util.ProcessTree: setsid exited with exit = code 0
2013-05-24 18:21:13,087 INFO org.apache.hadoop.mapred.Task:=A0 Using Resour= ceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1= 358f03
2013-05-24 18:21:13,452 WARN org.apache.hadoop.io.compress.snappy= .LoadSnappy: Snappy native library is available
2013-05-24 18:21:13,452 INFO org.apache.hadoop.io.compress.snappy.LoadSnapp= y: Snappy native library loaded
2013-05-24 18:21:13,464 INFO org.apache.= hadoop.mapred.MapTask: numReduceTasks: 1
2013-05-24 18:21:13,477 INFO or= g.apache.hadoop.mapred.MapTask: io.sort.mb =3D 100
2013-05-24 18:21:13,635 INFO org.apache.hadoop.mapred.MapTask: data buffer = =3D 79691776/99614720
2013-05-24 18:21:13,635 INFO org.apache.hadoop.map= red.MapTask: record buffer =3D 262144/327680
2013-05-24 18:21:13,724 INF= O org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay= .log) via org.mortbay.log.Slf4jLog
2013-05-24 18:21:13,733 INFO org.apache.hadoop.streaming.PipeMapRed: PipeMa= pRed exec [mapper.py]
2013-05-24 18:21:13,783 ERROR org.apache.hadoop.st= reaming.PipeMapRed: configuration exception
java.io.IOException: Cannot = run program "mapper.py": java.io.IOException: error=3D2, No such = file or directory
=A0=A0 =A0at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)
=A0= =A0 =A0at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:= 214)
=A0=A0 =A0at org.apache.hadoop.streaming.PipeMapper.configure(PipeM= apper.java:66)
=A0=A0 =A0at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)=A0=A0 =A0at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAcces= sorImpl.java:39)
=A0=A0 =A0at sun.reflect.DelegatingMethodAccessorImpl.i= nvoke(DelegatingMethodAccessorImpl.java:25)
=A0=A0 =A0at java.lang.reflect.Method.invoke(Method.java:597)
=A0=A0 =A0= at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:8= 8)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.setConf(Reflectio= nUtils.java:64)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionU= tils.java:117)
=A0=A0 =A0at org.apache.hadoop.mapred.MapRunner.configure= (MapRunner.java:34)
=A0=A0 =A0at sun.reflect.NativeMethodAccessorImpl.in= voke0(Native Method)
=A0=A0 =A0at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess= orImpl.java:39)
=A0=A0 =A0at sun.reflect.DelegatingMethodAccessorImpl.in= voke(DelegatingMethodAccessorImpl.java:25)
=A0=A0 =A0at java.lang.reflec= t.Method.invoke(Method.java:597)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUt= ils.java:88)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.setConf= (ReflectionUtils.java:64)
=A0=A0 =A0at org.apache.hadoop.util.Reflection= Utils.newInstance(ReflectionUtils.java:117)
=A0=A0 =A0at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:387= )
=A0=A0 =A0at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)=A0=A0 =A0at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
=A0= =A0 =A0at java.security.AccessController.doPrivileged(Native Method)
=A0=A0 =A0at javax.security.auth.Subject.doAs(Subject.java:396)
=A0=A0 = =A0at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma= tion.java:1278)
=A0=A0 =A0at org.apache.hadoop.mapred.Child.main(Child.j= ava:260)
Caused by: java.io.IOException: java.io.IOException: error=3D2,= No such file or directory
=A0=A0 =A0at java.lang.UNIXProcess.<init>(UNIXProcess.java:148)
= =A0=A0 =A0at java.lang.ProcessImpl.start(ProcessImpl.java:65)
=A0=A0 =A0= at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
=A0=A0 =A0...= 24 more
2013-05-24 18:21:13,869 INFO org.apache.hadoop.mapred.TaskLogsT= runcater: Initializing logs' truncater with mapRetainSize=3D-1 and redu= ceRetainSize=3D-1
2013-05-24 18:21:13,871 WARN org.apache.hadoop.mapred.Child: Error running = child
java.lang.RuntimeException: Error in configuring object
=A0=A0 = =A0at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.jav= a:93)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils= .java:64)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.newInstanc= e(ReflectionUtils.java:117)
=A0=A0 =A0at org.apache.hadoop.mapred.MapTas= k.runOldMapper(MapTask.java:387)
=A0=A0 =A0at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
=A0= =A0 =A0at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
=A0=A0 = =A0at java.security.AccessController.doPrivileged(Native Method)
=A0=A0 = =A0at javax.security.auth.Subject.doAs(Subject.java:396)
=A0=A0 =A0at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroup= Information.java:1278)
=A0=A0 =A0at org.apache.hadoop.mapred.Child.main(= Child.java:260)
Caused by: java.lang.reflect.InvocationTargetException=A0=A0 =A0at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)<= br> =A0=A0 =A0at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess= orImpl.java:39)
=A0=A0 =A0at sun.reflect.DelegatingMethodAccessorImpl.in= voke(DelegatingMethodAccessorImpl.java:25)
=A0=A0 =A0at java.lang.reflec= t.Method.invoke(Method.java:597)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUt= ils.java:88)
=A0=A0 =A0... 9 more
Caused by: java.lang.RuntimeExcepti= on: Error in configuring object
=A0=A0 =A0at org.apache.hadoop.util.Refl= ectionUtils.setJobConf(ReflectionUtils.java:93)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils= .java:64)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.newInstanc= e(ReflectionUtils.java:117)
=A0=A0 =A0at org.apache.hadoop.mapred.MapRun= ner.configure(MapRunner.java:34)
=A0=A0 =A0... 14 more
Caused by: java.lang.reflect.InvocationTargetExcep= tion
=A0=A0 =A0at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Me= thod)
=A0=A0 =A0at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMet= hodAccessorImpl.java:39)
=A0=A0 =A0at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth= odAccessorImpl.java:25)
=A0=A0 =A0at java.lang.reflect.Method.invoke(Met= hod.java:597)
=A0=A0 =A0at org.apache.hadoop.util.ReflectionUtils.setJob= Conf(ReflectionUtils.java:88)
=A0=A0 =A0... 17 more
Caused by: java.lang.RuntimeException: configurati= on exception
=A0=A0 =A0at org.apache.hadoop.streaming.PipeMapRed.configu= re(PipeMapRed.java:230)
=A0=A0 =A0at org.apache.hadoop.streaming.PipeMap= per.configure(PipeMapper.java:66)
=A0=A0 =A0... 22 more
Caused by: java.io.IOException: Cannot run program= "mapper.py": java.io.IOException: error=3D2, No such file or dir= ectory
=A0=A0 =A0at java.lang.ProcessBuilder.start(ProcessBuilder.java:4= 60)
=A0=A0 =A0at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMa= pRed.java:214)
=A0=A0 =A0... 23 more
Caused by: java.io.IOException: java.io.IOExceptio= n: error=3D2, No such file or directory
=A0=A0 =A0at java.lang.UNIXProce= ss.<init>(UNIXProcess.java:148)
=A0=A0 =A0at java.lang.ProcessImpl= .start(ProcessImpl.java:65)
=A0=A0 =A0at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
=A0= =A0 =A0... 24 more
2013-05-24 18:21:13,879 INFO org.apache.hadoop.mapred= .Task: Runnning cleanup for the task

--001a11c340c6306fb404dd7a4f07--