Mailing-List: contact dev-help@ant.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "Ant Developers List" <dev@ant.apache.org>
Received-SPF: pass (nike.apache.org: domain of xavier.hanin@gmail.com
 designates 209.85.218.210 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=MY4g8NCmDc7qYpvawrTqjoFmFmm4zzogLbS7m/mFjqCgc2UVp8WbStw4ZoJV5oYfXr
         3g4fIUdgN2n3HIft6TjgyngIMViEeLITuYUn1W6lay5NTVOVEpBL+TRiKvD8LC8uN/Nl
         94s55emxYKaIJR0NbDL0tm/xZxjUhcBCc8pVc=
MIME-Version: 1.0
In-Reply-To: <7479d1a70911170755r2f271300hd15864851f27346c@mail.gmail.com>
References: <7479d1a70911110721y7bffb152s47c9844b015eafec@mail.gmail.com>
	 <7479d1a70911160601t4707a128p344c104423e0700b@mail.gmail.com>
	 <635a05060911170618o1cae0a14u3fa39ccbe164d97e@mail.gmail.com>
	 <200911171550.11326.nicolas.lalevee@hibnet.org>
	 <7479d1a70911170755r2f271300hd15864851f27346c@mail.gmail.com>
Date: Tue, 17 Nov 2009 17:30:05 +0100
Message-ID: <635a05060911170830m75c789dfqbc65e286dc41b44a@mail.gmail.com>
Subject: Re: Ivy Indexer
From: Xavier Hanin <xavier.hanin@gmail.com>
To: Ant Developers List <dev@ant.apache.org>
Content-Type: multipart/alternative; boundary=0016e6d99b25867e33047893a305

--0016e6d99b25867e33047893a305
Content-Type: text/plain; charset=ISO-8859-1

2009/11/17 Jon Schneider <jkschneider@gmail.com>

>
> > If the index grows, accessing the index from a remote box may become
> long.
> > If you think big, you will have to find a way to transfer index updates
> to
> > the clients which is optimizing the network, such as transferring diffs
> or
> > something similar. But this becomes difficult to implement, unless you
> want
> > to rely on existing technology for that (such as a SCM).
>
> I am having trouble trying to manufacture a scalability problem here (with
> my unscientific approach).  I am up to 1,149 jars containing class types
> with over 28,700 types in my test repository and the index is at 39 mb.
>  I've pushed the index out on a remote filesystem, and the quick search
> opens the index in 219 ms.  After the index reader is opened, subsequent
> searches return in the microsecond range until the reader becomes stale
> from
> a commit and is reopened.
>
Yes, I think the main point is to "get" the index locally. At 39mb depending
on your bandwidth to the remote server it can take time... and having to
doanload the full index each time it is modified sounds scary. But maybe
Nicolas has good things to share about that.

Xavier

-- 
Xavier Hanin - 4SH France - http://www.4sh.fr/
BordeauxJUG creator & leader - http://www.bordeauxjug.org/
Apache Ivy Creator - http://ant.apache.org/ivy/

--0016e6d99b25867e33047893a305--