hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <Stanislav.Selt...@sungard.com>
Subject RE: Map-reduce sample code not working for hadoop streaming
Date Mon, 29 Aug 2011 14:16:44 GMT
Hadoop is not supported on windows xp
Use linux

-----Original Message-----
From: ws_dev2001 [mailto:ws_dev2001@yahoo.com] 
Sent: 29 августа 2011 г. 10:13
To: core-user@hadoop.apache.org
Subject: Map-reduce sample code not working for hadoop streaming


Hi,
I am trying to run the following code sample: 
http://pages.cs.brandeis.edu/~cs147a/lab/hadoop-example/
I am on Windows XP, Cygwin and am using hadoop-0.20.2.

I am getting stuck on an error while running the hadoop streaming sample on
this page. Please let me know if I need to supply further information.

hadoop@ ~
$ /usr/local/hadoop-0.20.2/bin/hadoop jar
E:/Tools/cygwin/usr/local/hadoop-0.20.2/contrib/streaming/hadoop-0.20.2-streaming.jar
-mapper python multifetch-mapper.py -file /tmp/multifetch-mapper.py -reducer
python multifetch-reducer.py -file /tmp/multifetch-reducer.py -input urls/*
-output titles
packageJobJar: [/tmp/multifetch-mapper.py, /tmp/multifetch-reducer.py,
/E:/tmp/hadoop/hadoop-unjar9032604726399647405/] [] C:\Documents and
Settings\hadoop\streamjob1540735851960870565.jar tmpDir=null
11/08/29 16:22:34 INFO mapred.FileInputFormat: Total input paths to process
: 2
11/08/29 16:22:34 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop/mapred/local]
11/08/29 16:22:34 INFO streaming.StreamJob: Running job:
job_201108261641_0042
11/08/29 16:22:34 INFO streaming.StreamJob: To kill this job, run:
11/08/29 16:22:34 INFO streaming.StreamJob:
E:\Tools\cygwin\usr\local\hadoop-0.20.2\/bin/hadoop job 
-Dmapred.job.tracker=localhost:9002 -kill job_201108261641_0042
11/08/29 16:22:34 INFO streaming.StreamJob: Tracking URL:
http://localhost:50030
/jobdetails.jsp?jobid=job_201108261641_0042
11/08/29 16:22:35 INFO streaming.StreamJob:  map 0%  reduce 0%
11/08/29 16:22:53 INFO streaming.StreamJob:  map 50%  reduce 0%
11/08/29 16:23:04 INFO streaming.StreamJob:  map 100%  reduce 0%
11/08/29 16:49:17 INFO streaming.StreamJob:  map 50%  reduce 0%
11/08/29 16:49:23 INFO streaming.StreamJob:  map 100%  reduce 0%
11/08/29 18:48:28 INFO streaming.StreamJob:  map 50%  reduce 0%
11/08/29 18:48:52 INFO streaming.StreamJob:  map 100%  reduce 0%
11/08/29 18:48:55 INFO streaming.StreamJob:  map 50%  reduce 0%
11/08/29 18:48:58 INFO streaming.StreamJob:  map 100%  reduce 0%
11/08/29 18:49:01 INFO streaming.StreamJob:  map 100%  reduce 17%
11/08/29 18:49:07 INFO streaming.StreamJob:  map 100%  reduce 0%
11/08/29 18:49:16 INFO streaming.StreamJob:  map 100%  reduce 17%
11/08/29 18:49:22 INFO streaming.StreamJob:  map 100%  reduce 0%
11/08/29 18:52:43 INFO streaming.StreamJob:  map 100%  reduce 100%
11/08/29 18:52:43 INFO streaming.StreamJob: To kill this job, run:
11/08/29 18:52:43 INFO streaming.StreamJob:
E:\Tools\cygwin\usr\local\hadoop-0.20.2\/bin/hadoop job 
-Dmapred.job.tracker=localhost:9002 -kill job_201108261641_0042
11/08/29 18:52:43 INFO streaming.StreamJob: Tracking URL:
http://localhost:50030
/jobdetails.jsp?jobid=job_201108261641_0042
11/08/29 18:52:43 ERROR streaming.StreamJob: Job not Successful!
11/08/29 18:52:43 INFO streaming.StreamJob: killJob...
Streaming Job Failed!

Please help me out on this.
TIA,
R2D2.

-- 
View this message in context: http://old.nabble.com/Map-reduce-sample-code-not-working-for-hadoop-streaming-tp32357180p32357180.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.


Mime
View raw message