Mailing-List: contact users-help@subversion.apache.org; run by ezmlm
Precedence: bulk
Received-SPF: pass (nike.apache.org: domain of bema@dei.uc.pt designates
 193.137.203.253 as permitted sender)
Subject: Re: Problem Loading Huge Repository
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: multipart/alternative; boundary=Apple-Mail-75--750380778
From: Bruno Antunes <bema@dei.uc.pt>
In-Reply-To: <BANLkTi=DFPygG4zMXGRJtyxE11PbLOegbg@mail.gmail.com>
Date: Fri, 17 Jun 2011 01:08:20 +0100
Cc: users@subversion.apache.org
Message-Id: <F5CA0260-AD82-4D62-AF75-BCDFF07177CF@dei.uc.pt>
References: <E3FA99A1-C0E7-4962-BE6C-ACB3B71D100D@dei.uc.pt>
 <BANLkTi=DFPygG4zMXGRJtyxE11PbLOegbg@mail.gmail.com>
To: Geoff Hoffman <ghoffman@cardinalpath.com>


--Apple-Mail-75--750380778
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii


On Jun 17, 2011, at 24:59 , Geoff Hoffman wrote:

>=20
>=20
> On Thu, Jun 16, 2011 at 4:05 PM, Bruno Antunes <bema@dei.uc.pt> wrote:
> Hi,
>=20
> As part of the work of my PhD thesis I need to load the ASF Subversion =
repository into my own local repository in order to mine and extract =
information from the repository without overloading the ASF servers.
>=20
> I have downloaded the repository dump and started loading it into my =
own repository. But the repository is huge (~45GB), and loading it using =
'svnadmin load' will take me days (~15).
>=20
> I tried 'svndumpfilter' to filter out some projects but I get the =
error 'svndumpfilter: Unsupported dumpfile version: 3'. I'm using =
'svndumpfilter' version 1.6.12. Is there any way to overcome this error?
>=20
> Do you know any faster way to load the dump file or to filter out some =
projects/revisions so I can speed up the process?
>=20
> Thank you in advance.
>=20
> Best regards,
> Bruno Antunes
>=20
>=20
>=20
> Just a thought... Do you need the revision history or only the current =
(head) revision?
>=20
> Guessing if you do not need the revision history then it will be much =
smaller and  faster to svn export their-stuff -r HEAD

I need the entire revision history, because I need to extract historical =
information from the repository.
But I could use the revision history from specific projects only, I =
don't need the entire repository, which contains all the ASF projects. =
The problem is I can filter these projects in the dump file.

Best regards,
Bruno Antunes=

--Apple-Mail-75--750380778
Content-Transfer-Encoding: 7bit
Content-Type: text/html;
	charset=us-ascii

<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br><div><div>On Jun 17, 2011, at 24:59 , Geoff Hoffman wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><br><br><div class="gmail_quote">On Thu, Jun 16, 2011 at 4:05 PM, Bruno Antunes <span dir="ltr">&lt;<a href="mailto:bema@dei.uc.pt">bema@dei.uc.pt</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Hi,<br>
<br>
As part of the work of my PhD thesis I need to load the ASF Subversion repository into my own local repository in order to mine and extract information from the repository without overloading the ASF servers.<br>
<br>
I have downloaded the repository dump and started loading it into my own repository. But the repository is huge (~45GB), and loading it using 'svnadmin load' will take me days (~15).<br>
<br>
I tried 'svndumpfilter' to filter out some projects but I get the error 'svndumpfilter: Unsupported dumpfile version: 3'. I'm using 'svndumpfilter' version 1.6.12. Is there any way to overcome this error?<br>

<br>
Do you know any faster way to load the dump file or to filter out some projects/revisions so I can speed up the process?<br>
<br>
Thank you in advance.<br>
<br>
Best regards,<br>
<font color="#888888">Bruno Antunes</font></blockquote></div><br><br clear="all"><br><div>Just a thought... Do you need the revision history or only the current (head) revision?</div><div><br></div><div>Guessing if you do not need the revision history then it will be much smaller and &nbsp;faster to svn export their-stuff -r HEAD</div></blockquote><br></div><div>I need the entire revision history, because I need to extract historical information from the repository.</div><div>But I could use the revision history from specific projects only, I don't need the entire repository, which contains all the ASF projects. The problem is I can filter these projects in the dump file.</div><div><br></div><div>Best regards,</div><div>Bruno Antunes</div></body></html>
--Apple-Mail-75--750380778--