Mailing-List: contact mapreduce-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-dev@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates
 209.85.218.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAMEEY-Lm+qgWM3xhqhhhRcLy6yj865U7j=up2soq8rif1BC27w@mail.gmail.com>
References: 
 <CAMEEY-Lm+qgWM3xhqhhhRcLy6yj865U7j=up2soq8rif1BC27w@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Thu, 18 Aug 2011 19:29:04 +0530
Message-ID: 
 <CAOcnVr27+KdzuVCoxJTb0gCP-OrXZZjnQRBmKi0LrDNNOT7Bsw@mail.gmail.com>
Subject: Re: Notes for working on mapreduce trunk after the MR-279 merge.
To: mapreduce-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Awesome Vinod, thanks much for these instructions!

Perhaps these may be recorded on the frequented wiki HowToContribute
pages as well? :)

On Thu, Aug 18, 2011 at 6:19 PM, Vinod Kumar Vavilapalli
<vinodkv@hortonworks.com> wrote:
> MR-279 branch is merged into mapreduce trunk and this changes things a
> bit for developing on mapreduce.
>
> You can get all the help that is needed from the INSTALL file at
> http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-mapreduce/INST=
ALL.
> Reproducing some of those contents here for the short-term lookup.
>
> ------------------------------------
> Checking out source code
> ------------------------------------
> svn checkout http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-m=
apreduce
>
> --------------------------
> Directory structure
> --------------------------
>
> trunk/
> =A0- hadoop-mapreduce ( was mapreduce before)
>
> trunk/hadoop-mapreduce - Classic code. JT/TT reside here
> =A0- build.xml
> =A0- src
>
> trunk/hadoop-mapreduce/ - New code related to yarn reside here.
> =A0- assembly
> =A0- pom.xml
> =A0- hadoop-mr-client
> =A0- hadoop-yarn - Yarn APIs, libraries, and server code
> =A0 -- hadoop-yarn-api
> =A0 -- hadoop-yarn-common
> =A0 -- hadoop-yarn-server - Server code, ResourceManager, NodeManager,
> server libraries and tests.
> =A0 =A0 =A0--- hadoop-yarn-server-common
> =A0 =A0 =A0--- hadoop-yarn-server-nodemanager
> =A0 =A0 =A0--- hadoop-yarn-server-resourcemanager
> =A0 =A0 =A0--- hadoop-yarn-server-tests
> =A0- hadoop-mr-client - MapReduce server and client code
> =A0 -- hadoop-mapreduce-client-app
> =A0 -- hadoop-mapreduce-client-core
> =A0 -- hadoop-mapreduce-client-jobclient
> =A0 -- hadoop-mapreduce-client-common
> =A0 -- hadoop-mapreduce-client-hs
> =A0 -- hadoop-mapreduce-client-shuffle
>
> -----------
> Building
> -----------
> Building yarn code and install into the local maven cache.
> =A0- mvn clean install
> =A0- In case you want to skip the tests run: mvn clean install -DskipTest=
s
>
> Building classic code once yarn code is built.
> =A0- ant veryclean jar jar-test =A0-Dresolvers=3Dinternal
>
> ----------
> Eclipse
> -----------
> =A01) For hacking on the new yarn+MR code in eclipse, you should run
> "mvn eclipse:eclipse" and then import the checked out source root as a
> maven project.
> =A02) For developing on classic JT/TT code, running "ant eclipse" and
> importing as java project should continue to work.
>
> Hope that helps. If you run into issues, please send an email or
> create a JIRA issue.
>
> Thanks,
> +Vinod
>


--=20
Harsh J