Mailing-List: contact infrastructure-dev-help@apache.org; run by ezmlm
Precedence: bulk
Reply-To: infrastructure-dev@apache.org
Received-SPF: pass (nike.apache.org: domain of owen.omalley@gmail.com
 designates 74.125.83.178 as permitted sender)
Subject: Re: HADOOP-7106: Re-organize hadoop subversion layout
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: text/plain; charset=us-ascii
From: Owen O'Malley <omalley@apache.org>
In-Reply-To: <BANLkTi=+cQBhsNjwdzB+fhcDkePJ=gSOqQ@mail.gmail.com>
Date: Wed, 20 Apr 2011 08:00:16 -0700
Cc: Nigel Daley <ndaley@mac.com>,
 Ian Holsman <ian@holsman.net>,
 infrastructure-dev@apache.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <9B529359-B589-4229-BA96-188C762A8E31@apache.org>
References: <C955EB7A.2E753%sureshms@yahoo-inc.com>
 <E2932D45-FF26-4579-A975-A98D2578622A@mac.com>
 <B98835A6-F4B7-426E-B22F-B2BEBE273C47@mac.com>
 <4112B27D-7DCF-4C8E-AD61-6884BA7E738C@mac.com>
 <844F39DC-0A5D-4AAE-AF8D-EFD4CC83C18A@mac.com>
 <BANLkTin+SyXE0tnfwhhH9P=wR0b7wCOHaw@mail.gmail.com>
 <BANLkTi=+cQBhsNjwdzB+fhcDkePJ=gSOqQ@mail.gmail.com>
To: general@hadoop.apache.org


On Apr 19, 2011, at 10:58 PM, Todd Lipcon wrote:

> On Tue, Apr 19, 2011 at 10:20 PM, Todd Lipcon <todd@cloudera.com> =
wrote:
>=20
>>=20
>> I'm currently looking into how the git mirrors are setup in =
Apache-land.

Uh, why isn't infra-dev on this thread?

For those on infra-dev, the context is that Nigel is trying to merge =
together the source trees of the Hadoop sub-projects that were split =
apart 2 years ago. So he is taking:

prefix =3D http://svn.apache.org/repos/asf/hadoop/

$prefix/common/trunk -> $prefix/trunk/common
$prefix/hdfs/trunk -> $prefix/trunk/hdfs
$prefix/mapreduce/trunk -> $prefix/trunk/mapreduce

and play similar games with the rest of the branches and tags. For more =
details look at HADOOP-7106.

=46rom the project split, subversion was able to track the history =
across the subversion moves between projects, but not git.

Four questions:
 1. Is there anything we can do to minimize the history loss in git?
 2. Are we going to be able to preserve our sha's or are they going to =
change again?
 3. What changes do we need to make to the subversion notification file?
 4. Are there any other changes that need to be coordinated?

After considering it this morning, I believe that the least disruptive =
move is to leave common at the same url and merge hdfs and mapreduce =
back in:

$prefix/common/trunk/* -> $prefix/common/trunk/common/*
$prefix/hdfs/trunk -> $prefix/common/trunk/hdfs
$prefix/mapreduce/trunk -> $prefix/common/trunk/mapreduce

This will preserve the hashes and history for common (and the 20 =
branches). We'll still need to play git voodoo to get git history for =
hdfs and mapreduce, but it is far better than starting a brand new git =
clone.

-- Owen