hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Running a Job in a Local Job Runner:Windows 7 64-bit
Date Fri, 07 Mar 2014 03:37:18 GMT
Running your Driver class from Eclipse should automatically run it in
the local runner mode (as thats the default mode).

You shouldn't need a local Hadoop install for this.

On Thu, Mar 6, 2014 at 11:36 AM, Radhe Radhe
<radhe.krishna.radhe@live.com> wrote:
> Hi All,
> I'm trying to get some hands-on on the Map Reduce programming.
> I downloaded the code examples from Hadoop-The definitive guide, 3rd edition
> and build it using Maven:
> mvn package -DskipTests -Dhadoop.distro=apache-2
> Next I imported the maven projects into Eclipse. Using Eclipse now I can
> develop my own Map Reduce jobs.
> Bu how do I test\run the job locally using the "Local Job Runner"?
> The book excerpt says:
> Now we can run this application against some local files. Hadoop comes with
> a local
> job runner, a cut-down version of the MapReduce execution engine for running
> Map-
> Reduce jobs in a single JVM. It's designed for testing, and is very
> convenient for use in
> an IDE, since you can run it in a debugger to step through the code in your
> mapper and
> reducer.
> Do I also need to install Hadoop locally on Windows for that?
> Thanks,
> -RR

Harsh J

View raw message