Return-Path: X-Original-To: apmail-archiva-users-archive@www.apache.org Delivered-To: apmail-archiva-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A0F45ED55 for ; Mon, 4 Feb 2013 17:40:51 +0000 (UTC) Received: (qmail 89223 invoked by uid 500); 4 Feb 2013 17:40:51 -0000 Delivered-To: apmail-archiva-users-archive@archiva.apache.org Received: (qmail 89049 invoked by uid 500); 4 Feb 2013 17:40:50 -0000 Mailing-List: contact users-help@archiva.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@archiva.apache.org Delivered-To: mailing list users@archiva.apache.org Received: (qmail 89037 invoked by uid 99); 4 Feb 2013 17:40:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Feb 2013 17:40:50 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of predatorvi@gmail.com designates 209.85.212.181 as permitted sender) Received: from [209.85.212.181] (HELO mail-wi0-f181.google.com) (209.85.212.181) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Feb 2013 17:40:46 +0000 Received: by mail-wi0-f181.google.com with SMTP id hm6so1963428wib.14 for ; Mon, 04 Feb 2013 09:40:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=6rPcRhQdR6gRf4h/qTFiuNoP36Pnir5SEksLOvq9Yj8=; b=K+LyblNxMrybWixhhL5Nr+gUlPRt81XMWqOK/piS2+IXsmerBON1emGLKok2vE2uGd PkDvwg+XT2Xpp7hCkkrdPrx7KbIjZOdXPZO8hzB9gEvY/0ON20vIGxqEfP1LYAHvIh6e TIr/LrM7wchGL5uAHpvX2adU5lTc3JA/l1OvGVyebqUzktux0IhIWAc2+VFSZY6M3/fU QNfWxmxHh4RfaKNNBdpMCAAODZiiZ4lzddRDKap+W71imaQJPG+au0lBuA4DT7afc/3O QjQbnfw4X4tCN448QjLM2L0EXlm/KLwfok0omXK6FhvfRLx3kcvi9JXRohv6lSN86wnf kXfg== X-Received: by 10.194.83.97 with SMTP id p1mr37001955wjy.17.1359999623958; Mon, 04 Feb 2013 09:40:23 -0800 (PST) MIME-Version: 1.0 Received: by 10.194.54.38 with HTTP; Mon, 4 Feb 2013 09:40:03 -0800 (PST) In-Reply-To: References: From: Jeff Date: Mon, 4 Feb 2013 10:40:03 -0700 Message-ID: Subject: Re: Index help... To: users@archiva.apache.org Content-Type: multipart/alternative; boundary=047d7bb04c1c7b13ee04d4e9964b X-Virus-Checked: Checked by ClamAV on apache.org --047d7bb04c1c7b13ee04d4e9964b Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I'm now trying to switch up the index directories on my repositories and am banging my head. I've simply removed the "Index Directory" setting on my repos and I see the .indexer folder getting created. Which is good. However, according to http://archiva.apache.org/docs/1.4-M3/adminguide/repositories.html, it states: *Another directory named .index is also created at the root of the repository directory. This is not configurable though as it contains the packaged/bundled index which is consumed by different consumers of the index such as M2Eclipse. * However, it is NOT getting created. I've restarted tomcat, I've forced a full index scan on every repository as well as a Directory scan. The above statement also lead me to believe that regardless of the location of ".indexer" that ".index" would still get created at the root but it isn't. On one repository I tried setting "Index Directory" to ".index", but I get an error that it can't create "/usr/share/tomcat6/.index". Thanks for any additional direction... On Mon, Feb 4, 2013 at 8:47 AM, Jeff wrote: > I don't *yet* have a need, but our user base is growing and so is our > CI/CD pipeline (number of GO and Jenkins build agents/slaves) and I wante= d > to plan ahead. I am trying to find the document that talked about keepin= g > indexes local while allowing a shared repo, but I have been unsuccessful > thus far. Maybe I dreamed it up. :-) > > Thanks for your help. > > > On Mon, Feb 4, 2013 at 2:56 AM, Olivier Lamy wrote: > >> complicated to have scabality when serving files :-( >> we don't (yet) any sync possible (that's something we start discussing >> on dev@ with maybe using new Apache project called helix). >> With your setup each repository will be independent. >> Do you have so many users to need that ? >> >> 2013/2/2 Jeff : >> > I will do that. >> > >> > However, how do I configure the repository to support the previously >> > mentioned horizontal scaling with a shared repository? >> > >> > >> > On Sat, Feb 2, 2013 at 10:26 AM, Olivier Lamy wrote= : >> > >> >> our default is .indexer. >> >> Oh I believe using an absolute path for the index location doesn't >> >> work and it's not available via http(s). >> >> Can you simply change the index path to .index or leave it blank >> >> (default is .indexer) ? >> >> As it that will be available as this one >> >> >> https://archiva-repository.apache.org/archiva/repository/snapshots/.inde= xer >> >> >> >> >> >> >> >> 2013/2/2 Jeff : >> >> > Also, isn't the default index directory supposed to be .index? >> That's >> >> what >> >> > it seems to be on Maven Central. >> >> > >> >> > http://repo.maven.apache.org/maven2/.index/ >> >> > >> >> > Thanks. >> >> > >> >> > >> >> > On Fri, Feb 1, 2013 at 3:28 PM, Jeff wrote: >> >> > >> >> >> If I attempt to go to a similar URL for any of our repositories >> there is >> >> >> no .indexer or .index path such as: >> >> >> >> >> >> http://archiva/repository/dna-releases/.indexer >> >> >> http://archiva/repository/dna-snapshots/.index >> >> >> http://archiva/repository/dnabackend-releases/.indexer >> >> >> http://archiva/repository/dnabackend-snapshots/.index >> >> >> >> >> >> Is this because I moved them? If so, I am happy to put them back >> to the >> >> >> normal location, but then what would change to allow multiple >> archiva >> >> >> tomcat servers to use the same 'data' repositories? >> >> >> >> >> >> >> >> >> >> >> >> On Fri, Feb 1, 2013 at 2:10 PM, Olivier Lamy >> wrote: >> >> >> >> >> >>> 2013/2/1 Jeff : >> >> >>> > I'm not sure what you mean by "why you don't access to indexes >> via >> >> >>> http"... >> >> >>> Something like >> >> >>> >> >> >> https://archiva-repository.apache.org/archiva/repository/snapshots/.inde= xer/ >> >> >>> >> >> >>> it's available for all repositories (and for group too since >> 1.4-M2 in >> >> >>> path lie archiva/repository/${grouprepositoryId}/.indexer/ >> >> >>> >> >> >>> Don't know exactly how it works in IDE. But they use remote index= es >> >> >>> available via http(s) and not file system directories. >> >> >>> ? >> >> >>> >> >> >>> > >> >> >>> > When I setup Archiva running in Tomcat 6 under CentOS 6.2 Linux= , >> I >> >> have >> >> >>> the >> >> >>> > folder structure below: >> >> >>> > >> >> >>> > /archiva >> >> >>> > /conf >> >> >>> > /data >> >> >>> > /derbydb >> >> >>> > /indexes >> >> >>> > /logs >> >> >>> > >> >> >>> > I think the only thing that is not standard is the 'indexes' >> >> directory. >> >> >>> I >> >> >>> > was trying to setup Archiva and anticipate possibly needing to >> scale >> >> >>> > horizontally by adding multiple front end servers behind our lo= ad >> >> >>> balancer. >> >> >>> > I read somewhere (I thought) that the indexes are specific to >> each >> >> >>> front >> >> >>> > end server, but that the repository data could be shared, so I >> >> mounted >> >> >>> the >> >> >>> > /archiva/data folder as a remote NFS mount. The rest of the >> folders >> >> >>> above >> >> >>> > are located physically on the archiva server. >> >> >>> > >> >> >>> > For each repository, the index folder is set to something like: >> >> >>> > >> >> >>> > /archiva/indexes/team1-releases >> >> >>> > /archiva/indexes/team1-snapshots >> >> >>> > >> >> >>> > But my understanding is that these indexes are the internal >> Archiva >> >> >>> > indexes, not the publicly consumable indexes. Nowhere in the >> >> >>> > /archiva/data/repositories/team1-releases or other repositories >> are >> >> >>> there >> >> >>> > any .index folders. >> >> >>> > >> >> >>> > I also have a single repository group that proxies all internal >> and >> >> >>> > externally proxied repositories under a single virtual >> repository and >> >> >>> there >> >> >>> > are no indexes consolidated under that repository group either >> which >> >> is >> >> >>> > what I thought was added in 1.4-M2 (the ability to consolidate >> >> indexes). >> >> >>> > >> >> >>> > Inside of /archiva/indexes, each repository index does have a >> bunch >> >> of >> >> >>> > files that look like: >> >> >>> > >> >> >>> > _7.fdt >> >> >>> > _7.fdx >> >> >>> > ... >> >> >>> > nexux-maven-reposotory-index.6948.gz >> >> >>> > nexux-maven-reposotory-index.6949.gz >> >> >>> > nexux-maven-reposotory-index.6950.gz >> >> >>> > nexux-maven-reposotory-index.6951.gz >> >> >>> > ... >> >> >>> > >> >> >>> > So something is generating these (I assume correctly). >> >> >>> > >> >> >>> > Also in each repository, the setting named "Skip Packed Index >> >> creation" >> >> >>> is >> >> >>> > NOT checked. >> >> >>> >> >> >>> Those nexux-maven-reposotory-index.xxx.gz files is incremental >> >> >>> generation. see a file called >> >> >>> nexus-maven-repository-index-packer.properties which contains som= e >> >> >>> metadatas on incremental generation. >> >> >>> > >> >> >>> > Hopefully that clarifies things and we can work this out and ge= t >> it >> >> >>> > addressed as needed for 1.4-M4 :-). >> >> >>> > >> >> >>> > >> >> >>> > On Fri, Feb 1, 2013 at 9:51 AM, Olivier Lamy >> >> wrote: >> >> >>> > >> >> >>> >> maybe there is an issue and setup indexes to a dedicated >> location >> >> >>> doesn't >> >> >>> >> work. >> >> >>> >> Is there any indexes files in archiva installation ? >> >> >>> >> >> >> >>> >> BTW why you don't access to indexes via http ? >> >> >>> >> >> >> >>> >> 2013/2/1 Jeff : >> >> >>> >> > Yep, multiple times. The server has been up and running for= a >> >> >>> number of >> >> >>> >> > months. >> >> >>> >> > On Feb 1, 2013 2:33 AM, "Olivier Lamy" >> wrote: >> >> >>> >> > >> >> >>> >> >> Did you try a full scan ? >> >> >>> >> >> >> >> >>> >> >> >> >> >>> >> >> 2013/1/31 Jeff : >> >> >>> >> >> > I'm currently using 1.4-M3 and have configured my Archiva >> >> indexes >> >> >>> to >> >> >>> >> >> point >> >> >>> >> >> > to a dedicated index folder located on the local host and >> put >> >> the >> >> >>> data >> >> >>> >> >> > folder on a shared NFS mount. >> >> >>> >> >> > >> >> >>> >> >> > However, the .index folder for local repos is not getting >> >> created >> >> >>> and >> >> >>> >> >> thus >> >> >>> >> >> > my IDE's can only see versions of what I have in my local >> .m2 >> >> >>> >> repository. >> >> >>> >> >> > >> >> >>> >> >> > I don't see anything in the logs suggesting that it is >> failing. >> >> >>> >> >> > >> >> >>> >> >> > Thoughts? >> >> >>> >> >> > >> >> >>> >> >> > -- >> >> >>> >> >> > Jeff Vincent >> >> >>> >> >> > predatorvi@gmail.com >> >> >>> >> >> > See my LinkedIn profile at: >> >> >>> >> >> > http://www.linkedin.com/in/rjeffreyvincent >> >> >>> >> >> > I =E2=99=A5 DropBox !! >> >> >>> >> >> >> >> >>> >> >> >> >> >>> >> >> >> >> >>> >> >> -- >> >> >>> >> >> Olivier Lamy >> >> >>> >> >> Talend: http://coders.talend.com >> >> >>> >> >> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >> >>> >> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> -- >> >> >>> >> Olivier Lamy >> >> >>> >> Talend: http://coders.talend.com >> >> >>> >> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >> >>> >> >> >> >>> > >> >> >>> > >> >> >>> > >> >> >>> > -- >> >> >>> > Jeff Vincent >> >> >>> > predatorvi@gmail.com >> >> >>> > See my LinkedIn profile at: >> >> >>> > http://www.linkedin.com/in/rjeffreyvincent >> >> >>> > I =E2=99=A5 DropBox !! >> >> >>> >> >> >>> >> >> >>> >> >> >>> -- >> >> >>> Olivier Lamy >> >> >>> Talend: http://coders.talend.com >> >> >>> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >> >>> >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> >> Jeff Vincent >> >> >> predatorvi@gmail.com >> >> >> See my LinkedIn profile at: >> >> >> http://www.linkedin.com/in/rjeffreyvincent >> >> >> I =E2=99=A5 DropBox !! >> >> >> >> >> > >> >> > >> >> > >> >> > -- >> >> > Jeff Vincent >> >> > predatorvi@gmail.com >> >> > See my LinkedIn profile at: >> >> > http://www.linkedin.com/in/rjeffreyvincent >> >> > I =E2=99=A5 DropBox !! >> >> >> >> >> >> >> >> -- >> >> Olivier Lamy >> >> Talend: http://coders.talend.com >> >> http://twitter.com/olamy | http://linkedin.com/in/olamy >> >> >> > >> > >> > >> > -- >> > Jeff Vincent >> > predatorvi@gmail.com >> > See my LinkedIn profile at: >> > http://www.linkedin.com/in/rjeffreyvincent >> > I =E2=99=A5 DropBox !! >> >> >> >> -- >> Olivier Lamy >> Talend: http://coders.talend.com >> http://twitter.com/olamy | http://linkedin.com/in/olamy >> > > > > -- > Jeff Vincent > predatorvi@gmail.com > See my LinkedIn profile at: > http://www.linkedin.com/in/rjeffreyvincent > I =E2=99=A5 DropBox !! > --=20 Jeff Vincent predatorvi@gmail.com See my LinkedIn profile at: http://www.linkedin.com/in/rjeffreyvincent I =E2=99=A5 DropBox !! --047d7bb04c1c7b13ee04d4e9964b--