Mailing-List: contact mapreduce-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-dev@hadoop.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: 
 <CAOcnVr27+KdzuVCoxJTb0gCP-OrXZZjnQRBmKi0LrDNNOT7Bsw@mail.gmail.com>
References: 
 <CAMEEY-Lm+qgWM3xhqhhhRcLy6yj865U7j=up2soq8rif1BC27w@mail.gmail.com>
	<CAOcnVr27+KdzuVCoxJTb0gCP-OrXZZjnQRBmKi0LrDNNOT7Bsw@mail.gmail.com>
Date: Thu, 18 Aug 2011 21:16:41 +0530
Message-ID: 
 <CAMEEY-KWHiu=w2o6fwjt5JG+_mFdUhQrtKHWYU8+HLjEFHtKCw@mail.gmail.com>
Subject: Re: Notes for working on mapreduce trunk after the MR-279 merge.
From: Vinod Kumar Vavilapalli <vinodkv@hortonworks.com>
To: mapreduce-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Good idea. Created http://wiki.apache.org/hadoop/DevelopingOnTrunkAfter279M=
erge

Please feel free to edit it. Once it stabilises, we can move the
content over to HowToContribute and/or something like
HowToBuildAndInstall.

Thanks,
+Vinod

On Thu, Aug 18, 2011 at 7:29 PM, Harsh J <harsh@cloudera.com> wrote:
> Awesome Vinod, thanks much for these instructions!
>
> Perhaps these may be recorded on the frequented wiki HowToContribute
> pages as well? :)
>
> On Thu, Aug 18, 2011 at 6:19 PM, Vinod Kumar Vavilapalli
> <vinodkv@hortonworks.com> wrote:
>> MR-279 branch is merged into mapreduce trunk and this changes things a
>> bit for developing on mapreduce.
>>
>> You can get all the help that is needed from the INSTALL file at
>> http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-mapreduce/INS=
TALL.
>> Reproducing some of those contents here for the short-term lookup.
>>
>> ------------------------------------
>> Checking out source code
>> ------------------------------------
>> svn checkout http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-=
mapreduce
>>
>> --------------------------
>> Directory structure
>> --------------------------
>>
>> trunk/
>> =A0- hadoop-mapreduce ( was mapreduce before)
>>
>> trunk/hadoop-mapreduce - Classic code. JT/TT reside here
>> =A0- build.xml
>> =A0- src
>>
>> trunk/hadoop-mapreduce/ - New code related to yarn reside here.
>> =A0- assembly
>> =A0- pom.xml
>> =A0- hadoop-mr-client
>> =A0- hadoop-yarn - Yarn APIs, libraries, and server code
>> =A0 -- hadoop-yarn-api
>> =A0 -- hadoop-yarn-common
>> =A0 -- hadoop-yarn-server - Server code, ResourceManager, NodeManager,
>> server libraries and tests.
>> =A0 =A0 =A0--- hadoop-yarn-server-common
>> =A0 =A0 =A0--- hadoop-yarn-server-nodemanager
>> =A0 =A0 =A0--- hadoop-yarn-server-resourcemanager
>> =A0 =A0 =A0--- hadoop-yarn-server-tests
>> =A0- hadoop-mr-client - MapReduce server and client code
>> =A0 -- hadoop-mapreduce-client-app
>> =A0 -- hadoop-mapreduce-client-core
>> =A0 -- hadoop-mapreduce-client-jobclient
>> =A0 -- hadoop-mapreduce-client-common
>> =A0 -- hadoop-mapreduce-client-hs
>> =A0 -- hadoop-mapreduce-client-shuffle
>>
>> -----------
>> Building
>> -----------
>> Building yarn code and install into the local maven cache.
>> =A0- mvn clean install
>> =A0- In case you want to skip the tests run: mvn clean install -DskipTes=
ts
>>
>> Building classic code once yarn code is built.
>> =A0- ant veryclean jar jar-test =A0-Dresolvers=3Dinternal
>>
>> ----------
>> Eclipse
>> -----------
>> =A01) For hacking on the new yarn+MR code in eclipse, you should run
>> "mvn eclipse:eclipse" and then import the checked out source root as a
>> maven project.
>> =A02) For developing on classic JT/TT code, running "ant eclipse" and
>> importing as java project should continue to work.
>>
>> Hope that helps. If you run into issues, please send an email or
>> create a JIRA issue.
>>
>> Thanks,
>> +Vinod
>>
>
>
>
> --
> Harsh J
>