Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of mblase23@gmail.com designates
 209.85.160.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <001801cd351c$02cf7840$086e68c0$@com>
References: 
 <CAL4PpoRskNxoZEqACPR=v7kRg2yhJUoczv+uQ1vrODEq83VGTw@mail.gmail.com>
	<CAE9W93PVi0yKPuDOCTjHTuxResVDe+U5hYDrf=VMrn8+crpAOQ@mail.gmail.com>
	<CAL4PpoTnZvJb_u1JXMq9m3WZKO_ujDd_UDHsRU1=4HqefWKq=w@mail.gmail.com>
	<CAEY5pxWUm9UDTPE_htfRLuhb9=6m6gA7UnStMvMUhYu3og3ycQ@mail.gmail.com>
	<CAL4PpoTpNP8UH=YwQZTWuixSzBoFPrOBQEH_EWhjbLzmoeQ3UQ@mail.gmail.com>
	<CAL4PpoQTk9uoSNXVsp2BDMOK=Z8BpwASOkPrPbSAZMR2vo1i0w@mail.gmail.com>
	<001801cd351c$02cf7840$086e68c0$@com>
Date: Fri, 18 May 2012 10:49:02 -0700
Message-ID: 
 <CAL4PpoSQ062O6pFpovNR1ESXrEMy_83dpft5EqCXF=VjxYFjvg@mail.gmail.com>
Subject: Re: old fashioned....."Too many open files"!
From: Michel Blase <mblase23@gmail.com>
To: java-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=e89a8fb208d0f5f10004c0532add

--e89a8fb208d0f5f10004c0532add
Content-Type: text/plain; charset=ISO-8859-1

but commit after each insert should be really expensive and unnecessary! no?

On Fri, May 18, 2012 at 10:31 AM, Edward W. Rouse <erouse@comsquared.com>wrote:

> Have you tried adding im.commit() after adding a document? Could be all of
> the uncommitted documents are leaving files open.
>
> > -----Original Message-----
> > From: Michel Blase [mailto:mblase23@gmail.com]
> > Sent: Friday, May 18, 2012 1:24 PM
> > To: java-user@lucene.apache.org
> > Subject: Re: old fashioned....."Too many open files"!
> >
> > also.....my problem is indexing!
> >
> > Preparation:
> >
> > private void SetUpWriters() throws Exception {
> >         Set set = IndexesPaths.entrySet();
> >         Iterator i = set.iterator();
> >
> >         while(i.hasNext()){
> >             Map.Entry index = (Map.Entry)i.next();
> >             int id = (Integer)index.getKey();
> >             String path = (String)index.getValue();
> >
> >             File app = new File(path);
> >             Directory dir = FSDirectory.open(app);
> >             IndexWriterConfig config = new
> > IndexWriterConfig(LuceneVersion.CurrentVersion,new
> > StandardAnalyzer(LuceneVersion.CurrentVersion));
> >
> >             //config.setMaxBufferedDocs(50);
> >             config.setRAMBufferSizeMB(400);
> >             TieredMergePolicy mp =
> > (TieredMergePolicy)config.getMergePolicy();
> >             mp.setUseCompoundFile(true);
> >             config.setMergePolicy(mp);
> >
> >             /*
> >             LogMergePolicy lmp =
> > (LogMergePolicy)config.getMergePolicy();
> >             lmp.setUseCompoundFile(true);
> >             lmp.setMaxMergeDocs(10000);
> >             config.setMergePolicy(lmp);
> >             */
> >
> >             Writers.put(id, new IndexWriter(dir,config));
> >         }
> >     }
> >
> >
> > adding document:
> >
> > public void AddDocument(Document doc,Analyzer analyzer) throws
> > CorruptIndexException, IOException {
> >         IndexWriter im = Writers.get(this.CurrentOpenIndex_ID);
> >         im.addDocument(doc, analyzer);
> >     }
> >
> >
> > there's not much more I'm doing!
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

--e89a8fb208d0f5f10004c0532add--