hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From santhosh kumar <santhosh...@gmail.com>
Subject mapreduce.Job hang/struck
Date Thu, 24 Sep 2015 20:13:52 GMT
Hi,

I am new to Hadoop, I installed hadoop on single node and running HDFS and YARN. I have written
map reducer program in python but when I execute this, the command hangs or struck.

/opt/hadoop/hadoop-2.6.0>./bin/hadoop jar /opt/hadoop/hadoop-2.6.0/share/hadoop/tools/lib/hadoop-streaming-2.6.0.jar
-mapper /Users/Hadoop/Documents/Python_MR/wcMapper.py -reducer /Users/Hadoop/Documents/Python_MR/wcReducer.py
-input /var/bigdata/input/movies.csv -output /var/bigdata/output -file /Users/Hadoop/Documents/Python_MR/wcMapper.py
-file /Users/Hadoop/Documents/Python_MR/wcReducer.py
15/09/25 01:30:02 WARN streaming.StreamJob: -file option is deprecated, please use generic
option -files instead.
15/09/25 01:30:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable
packageJobJar: [/Users/Hadoop/Documents/Python_MR/wcMapper.py, /Users/Hadoop/Documents/Python_MR/wcReducer.py,
/var/folders/24/pw5x8fqs6zn5pz4xfd9g80m80000gp/T/hadoop-unjar4491124020000582375/] [] /var/folders/24/pw5x8fqs6zn5pz4xfd9g80m80000gp/T/streamjob6794242123082786949.jar
tmpDir=null
15/09/25 01:30:03 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032
15/09/25 01:30:04 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032
15/09/25 01:30:05 INFO mapred.FileInputFormat: Total input paths to process : 1
15/09/25 01:30:05 INFO mapreduce.JobSubmitter: number of splits:2
15/09/25 01:30:05 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1443124681722_0001
15/09/25 01:30:05 INFO impl.YarnClientImpl: Submitted application application_1443124681722_0001
15/09/25 01:30:05 INFO mapreduce.Job: The url to track the job: http://santhoshs-MacBook-Pro.local:8088/proxy/application_1443124681722_0001/
15/09/25 01:30:05 INFO mapreduce.Job: Running job: job_1443124681722_0001
.
.
.

In the GUI, the Tracking UI  is set to ‘UNASSIGNED’.

Please let me know your expert comments !!!!

Regards,
santhosh
Mime
View raw message