hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Radhe Radhe <radhe.krishna.ra...@live.com>
Subject RE: Running a Job in a Local Job Runner:Windows 7 64-bit
Date Fri, 07 Mar 2014 18:54:06 GMT
Thanks a lot Harsh,

I just ran the Driver class from Eclipse and it worked fine.😊

Can I use local job runner to test Sequence File and Map File as well ?😌

-RR

> From: harsh@cloudera.com
> Date: Thu, 6 Mar 2014 19:37:18 -0800
> Subject: Re: Running a Job in a Local Job Runner:Windows 7 64-bit
> To: user@hadoop.apache.org
> 
> Running your Driver class from Eclipse should automatically run it in
> the local runner mode (as thats the default mode).
> 
> You shouldn't need a local Hadoop install for this.
> 
> On Thu, Mar 6, 2014 at 11:36 AM, Radhe Radhe
> <radhe.krishna.radhe@live.com> wrote:
> > Hi All,
> >
> > I'm trying to get some hands-on on the Map Reduce programming.
> >
> > I downloaded the code examples from Hadoop-The definitive guide, 3rd edition
> > and build it using Maven:
> > mvn package -DskipTests -Dhadoop.distro=apache-2
> >
> > Next I imported the maven projects into Eclipse. Using Eclipse now I can
> > develop my own Map Reduce jobs.
> > Bu how do I test\run the job locally using the "Local Job Runner"?
> >
> > The book excerpt says:
> > Now we can run this application against some local files. Hadoop comes with
> > a local
> > job runner, a cut-down version of the MapReduce execution engine for running
> > Map-
> > Reduce jobs in a single JVM. It's designed for testing, and is very
> > convenient for use in
> > an IDE, since you can run it in a debugger to step through the code in your
> > mapper and
> > reducer.
> >
> > Do I also need to install Hadoop locally on Windows for that?
> >
> > Thanks,
> > -RR
> 
> 
> 
> -- 
> Harsh J
 		 	   		  
Mime
View raw message