From bloodhound-dev-return-575-apmail-incubator-bloodhound-dev-archive=incubator.apache.org@incubator.apache.org Wed Aug 8 23:04:31 2012 Return-Path: X-Original-To: apmail-incubator-bloodhound-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-bloodhound-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B3A69D107 for ; Wed, 8 Aug 2012 23:04:31 +0000 (UTC) Received: (qmail 64826 invoked by uid 500); 8 Aug 2012 23:04:31 -0000 Delivered-To: apmail-incubator-bloodhound-dev-archive@incubator.apache.org Received: (qmail 64815 invoked by uid 500); 8 Aug 2012 23:04:31 -0000 Mailing-List: contact bloodhound-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: bloodhound-dev@incubator.apache.org Delivered-To: mailing list bloodhound-dev@incubator.apache.org Received: (qmail 64807 invoked by uid 99); 8 Aug 2012 23:04:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Aug 2012 23:04:31 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of gary.martin@wandisco.com designates 74.125.82.175 as permitted sender) Received: from [74.125.82.175] (HELO mail-we0-f175.google.com) (74.125.82.175) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Aug 2012 23:04:25 +0000 Received: by weyr6 with SMTP id r6so768134wey.6 for ; Wed, 08 Aug 2012 16:04:03 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:x-gm-message-state; bh=Xg5dqVR+FjQkkC4ux0vh6aL0/DSYD7TISCvRulHUPEE=; b=LLi9KwX6M66fe1/WRMZ3TleP31bg5jk07BQCMY6/N8w1ddmZEMjiqW9X11So5do8Dz PeSl6rojmNKzDtM7ymMfJjEO9u8G7Dd1VkH0pgcUlcfIFfMcVrmuhfG9eBJ3Xvl3VJix aYOECmbcyGt7t074vp/vOBrVItAIlE5yjY9KXWcIwmT8IlDreGc6ncSbF4ZEl8uLvUeQ cxvavstVZixqHbhTUH5WtqQ3v889Ir7oMcpLAcLDdQQ6+IUCqSIWqTBcewUEACEmidQ+ AVOEN/KQraOgBuaEj+CCVuwSjg6dnbCeoxUapGkRECw7Pkn5+kJ1ELfgClv05DsQUPFW uodw== Received: by 10.180.82.39 with SMTP id f7mr1608880wiy.2.1344467043535; Wed, 08 Aug 2012 16:04:03 -0700 (PDT) Received: from [192.168.1.202] ([146.90.126.75]) by mx.google.com with ESMTPS id l5sm11295191wix.5.2012.08.08.16.04.02 (version=SSLv3 cipher=OTHER); Wed, 08 Aug 2012 16:04:02 -0700 (PDT) Message-ID: <5022F061.8070206@wandisco.com> Date: Thu, 09 Aug 2012 00:04:01 +0100 From: Gary Martin User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120714 Thunderbird/14.0 MIME-Version: 1.0 To: Greg Stein CC: allura-dev@incubator.apache.org, bloodhound-dev@incubator.apache.org Subject: Re: [Apache Bloodhound] #156: Local copy of bloodhound part of Apache repo for browse functionality References: <052.a76dbce2fd5b36ba0b55ec49ab072067@incubator.apache.org> <067.9f1edfc161cac25f48e9a23ee7166717@incubator.apache.org> <50215E93.8090602@wandisco.com> <5022EA03.70808@wandisco.com> In-Reply-To: Content-Type: multipart/alternative; boundary="------------090909060100090100050104" X-Gm-Message-State: ALoCoQlL3S7DqLEr50kVxiXyLEtafyTDL1QHb6b7Jx1+W619IEdI5w4S560hZYifLIoB77jp7uHL X-Virus-Checked: Checked by ClamAV on apache.org --------------090909060100090100050104 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit I assumed that you would be able to confirm that! Actually, this approach could be very helpful as I was worried about having to sort out the python bindings for subversion 1.7 for the version of python that is used on the VM. If I don't need svnrdump, I should be able to use the standard distro packages. I assume that this is of less interest for the allura-dev list so sorry if this is a bit off topic for you. Cheers, Gary On 08/08/12 23:40, Greg Stein wrote: > > Subversion has no problems at all with NFS. > > On Aug 8, 2012 6:36 PM, "Gary Martin" > wrote: > > Hi everyone, > > I should work out how to test this suggestion but I would expect > it to work. I got Bloodhound set up with the postgresql backend so > that aspect should be fine (I seem to remember reading about > problems when using sqlite). After that, I assume that we can work > with everything as read-only from bloodhound's point of view. > > So, as long as subversion can also play nicely with NFS then I > have no current reason to suspect problems with this approach at > this point. > > Cheers, > Gary > > > On 08/08/12 22:26, Greg Stein wrote: > > Very cool! > > But with that said... I was on IRC, and the Infra guys might > actually > create a full repository mirror for us. The thing is that Apache > Allura (also incubating) will want a copy of their project(s), > too. > Tho... I think they're going with Git, but the concept is the > same. > Bloodhound and Allura both need local read-access to repositories. > > Infra was thinking about sync'ing repository copies over to a > box (I > forget the name). The BH and Allura VMs would be migrated over > to that > same box. The repositories would then be exposed via NFS, and > the two > VMs would (locally) mount that NFS share. > > I believe the Right Answer here is for both projects to > confirm that > this option is workable, and for us to ask Infra to start > setting it > up. > > Thoughts? > > Cheers, > -g > > On Tue, Aug 7, 2012 at 2:29 PM, Gary Martin > > > wrote: > > Not sure if this could be of interest beyond Bloodhound. > It is a very simple > script (and quite possibly over-complicated in reality). > > The attachment referred to is here: > https://issues.apache.org/bloodhound/attachment/ticket/156/emptyrevs.py > > Just tested it on 1229640 empty commits: > > python3 emptyrevs.py 1229640 | eatmydata svnadmin > --bypass-prop-validation load repos/ > > which took about 2 hours - I suspect that the svnadmin > load was the real > bottleneck.. it is just a few seconds to create about 92M > of data if you > direct to a file instead. > > Cheers, > Gary > > > > On 08/07/2012 06:47 PM, Apache Bloodhound wrote: > > #156: Local copy of bloodhound part of Apache repo for > browse > functionality > ------------------------+----------------------- > Reporter: gjm | Owner: nobody > Type: task | Status: new > Priority: critical | Milestone: Release 2 > Component: siteadmin | Version: > Resolution: | Keywords: > ------------------------+----------------------- > > Comment (by gjm): > > As part of my investigation around creating a > mirror of the bloodhound > portion, I have written a very simple script (only > complicated when I > decided to have a quick look at the argparse module > and python2/3 > issues), > inspired by a suggestion from Philip Martin. > > I have attached that script > [attachment:emptyrevs.py here]. It may be > worth putting in the bloodhound repository in case > we need it again of > course. > > --------------090909060100090100050104--