hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gunjan mishra <gunjanm...@gmail.com>
Subject Re: simple word count program remains un assigned...
Date Sun, 20 Oct 2013 13:28:35 GMT
Thanks very much Harsh ,

I am a newbie to this , so I don't know much about MR1 or MR2(YARN) , I
just updated my old cloudera distribution to the latest following
instructions on cloudera website. Thats probably lead me to YARN and I
checked and   I don't have MR1 files any more.

So please tell me if I should revert back to MR1 some how or I can continue
with YARN troubleshooting problems.

BTW thanks alot one more time.

Thanks



On Sat, Oct 19, 2013 at 11:26 PM, Harsh J <harsh@cloudera.com> wrote:

> For CDH-specific questions, you can post them onto the Cloudera
> Community forums: http://community.cloudera.com
>
> On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <gunjanmish@gmail.com>
> wrote:
> > HItesh ,
> >
> > My apologies , is there a different distribution list. Please can some
> one
> > point me to that.
> >
> > Thanks
> >
> >
> > On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hitesh@apache.org> wrote:
> >>
> >> Hello Gunjan,
> >>
> >> This mailing list is for Apache Hadoop related questions. Please post
> >> questions for other distributions to the appropriate vendor's mailing
> list.
> >>
> >> thanks
> >> -- Hitesh
> >>
> >> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
> >>
> >> > Hi I am trying to run a simple word count program , like this , job
> >> > keeps  running but is not being assigned to Mapper and reducers ...
> >> > while I checked the status
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > [root@localhost ~]# hadoop jar
> >> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
> >> > wordcount /usr/read.txt /usr/output
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> >> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
> >> > process : 1
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
> >> > Instead, use mapreduce.job.jar
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class
> is
> >> > deprecated. Instead, use mapreduce.job.output.value.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
> >> > deprecated. Instead, use mapreduce.job.combine.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
> >> > deprecated. Instead, use mapreduce.job.map.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
> >> > deprecated. Instead, use mapreduce.job.name
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
> >> > deprecated. Instead, use mapreduce.job.reduce.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
> >> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
> >> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
> >> > deprecated. Instead, use mapreduce.job.maps
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
> >> > deprecated. Instead, use mapreduce.job.output.key.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
> >> > deprecated. Instead, use mapreduce.job.working.dir
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
> >> > job: job_1382144693199_0005
> >> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
> >> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
> >> >
> http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job:
> >> > job_1382144693199_0005
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > here is my cloudera distribution
> >> >
> >> >
> >> > Hadoop 2.0.0-cdh4.4.0
> >> > Subversion
> >> >
> file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
> >> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> >> > Compiled by jenkins on Tue Sep  3 19:33:17 PDT 2013
> >> > From source with checksum ac7e170aa709b3ace13dc5f775487180
> >> > This command was run using
> >> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
> >> >
> >> >
> >> > and the outcome of jps (from root)
> >> >
> >> > -----------------------------------------
> >> > [root@localhost ~]# jps
> >> > 2202 TaskTracker
> >> > 4161 Bootstrap
> >> > 3134 DataNode
> >> > 3520 Application
> >> > 3262 NameNode
> >> > 1879 ThriftServer
> >> > 1740 Main
> >> > 3603 RunJar
> >> > 1606 HMaster
> >> > 2078 JobTracker
> >> > 16277 Jps
> >> > 3624 RunJar
> >> > 4053 RunJar
> >> > 4189 Sqoop
> >> > 3582 Bootstrap
> >> > 3024 JobHistoryServer
> >> > 3379 SecondaryNameNode
> >> > 4732 ResourceManager
> >> >
> >> > ------------------------------------------------------
> >> > --
> >> > Thanks & Regards
> >> > Gunjan Mishra
> >> > 732-200-5839(H)
> >> > 917-216-9739(C)
> >>
> >
> >
> >
> > --
> > Thanks & Regards
> > Gunjan Mishra
> > 732-200-5839(H)
> > 917-216-9739(C)
>
>
>
> --
> Harsh J
>



-- 
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)

Mime
View raw message