maven-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lyons, Roy" <Roy.Ly...@cmegroup.com>
Subject Re: System-wide, read-only repository
Date Wed, 30 Oct 2013 16:21:11 GMT
I am trying to get my unix admins to use it for us.  here are some
benchmarks I have seen.


On 10/30/13 10:51 AM, "Curtis Rueden" <ctrueden@wisc.edu> wrote:

>Hi Roy,
>
>> zfs has built in de-duplication.
>
>ZFS sounds awesome in theory but have you actually tried it? If so, how is
>it working for you? In particular, how is the performance?
>
>-Curtis
>
>
>On Wed, Oct 30, 2013 at 10:43 AM, Lyons, Roy <Roy.Lyons@cmegroup.com>
>wrote:
>
>> :) but like I said, you wouldnt worry about the space if it was all on
>> zfs.  zfs has built in de-duplication.  you could have 2000 local maven
>> repos and probably not fill your disk since most of it has to do with
>> duplicate jars and such.
>>
>> On 10/30/13 10:37 AM, "Curtis Rueden" <ctrueden@wisc.edu> wrote:
>>
>> >Hi all,
>> >
>> >There is plenty of room for improvement regarding reuse of Maven's
>>local
>> >repository cache. Releases in particular are supposed to be immutable
>>so
>> >once they are downloaded they could go into a read-only tier as
>>suggested
>> >by Stephen. Inventing such a scheme to reuse large portions of the repo
>> >cache would be of great benefit to the Maven community.
>> >
>> >E.g.: the recommended CIS strategy is for every job to use its own
>>local
>> >repo cache, which becomes very large. My Jenkins has dozens of Maven
>>build
>> >jobs and I cannot afford the bloat; my Jenkins backups are huge enough
>> >already. So what I do instead is limit my Maven Jenkins node to a
>>single
>> >executor, which is a real waste on a 16 core machine. Much better
>>would be
>> >if the jobs could share the bulk of the repo cache.
>> >
>> >So it's definitely an itch, but not quite itchy enough for anyone to
>> >scratch yet...
>> >
>> >Regards,
>> >Curtis
>> > On Oct 30, 2013 8:35 AM, "Mark H. Wood" <mwood@iupui.edu> wrote:
>> >
>> >> On Wed, Oct 30, 2013 at 10:18:49AM +0100, Matthieu Moy wrote:
>> >> > Barrie Treloar <baerrach@gmail.com> writes:
>> >> >
>> >> > > On 29 October 2013 23:56, Lyons, Roy <Roy.Lyons@cmegroup.com>
>> wrote:
>> >> > >> Unfortunately, you will always have something in
>> >>$HOME/.m2/repository
>> >> > >> because that's how maven works.
>> >> > >>
>> >> > >> Can I suggest perhaps that you use zfs for deduplication in
>>/home?
>> >> > >> Otherwise, you can add something like
>> >> > >
>> >> > > Or give them more disk space - isn't this stuff meant to be cheap
>> >> now-a-days?
>> >> >
>> >> > Local disk space is cheap. NFS-shared, RAID & backed-up disk space,
>> >>less
>> >> > so. I can live with a few Gb of waste, but I was just wondering
>> >>whether
>> >> > we could do any better.
>> >>
>> >> Disks are cheap.  But not free.  Running the procurement gantlet is
>> >> not free.  Downtime to install new storage is not free.  Lord knows
>> >> that additional backup tapes are not free, not even cheap.  Longer
>> >> backup windows are not free.  Throwing storage at the problem is
>>often
>> >> a reasonable choice, but it's also reasonable to always ask if there
>> >> isn't a better way.
>> >>
>> >> Sorry, I've been aching to write that for a long time....
>> >>
>> >> --
>> >> Mark H. Wood, Lead System Programmer   mwood@IUPUI.Edu
>> >> Machines should not be friendly.  Machines should be obedient.
>> >>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
>> For additional commands, e-mail: users-help@maven.apache.org
>>
>>


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org


Mime
View raw message