Mailing-List: contact general-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: general@lucene.apache.org
Received-SPF: unknown ~allinclude:spf.protection.outlook.com (nike.apache.org:
 encountered unrecognized mechanism during SPF processing of domain of
 mark.bennett@lucidworks.com)
From: Mark Bennett <mark.bennett@lucidworks.com>
To: "<general@lucene.apache.org>" <general@lucene.apache.org>
Subject: Re: IndexWriter.commit() performance
Thread-Topic: IndexWriter.commit() performance
Thread-Index: Ac5hdfRHEH5BwwcSST2KNBPWlBsmnwAAlOWA
Date: Tue, 4 Jun 2013 23:07:29 +0000
Message-ID: <B407DA2B-4ABC-450F-9B3D-6D4E9E7C2ED6@lucidworks.com>
References: 
 <A1D3F8F318575D4BB6C873E37566D8F4014B521C@agnesi.ActiveDirectopia.emailtopia.com>
In-Reply-To: 
 <A1D3F8F318575D4BB6C873E37566D8F4014B521C@agnesi.ActiveDirectopia.emailtopia.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="us-ascii"
Content-ID: <A5E9CB16FC0025408FB9843EA9434A0D@namprd06.prod.outlook.com>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Although it's not exactly what you asked (and I don't mean this as a sarcas=
tic answer), one idea is to not call it directly from your code.  Or use th=
e options that say "commit with N seconds"

This may not be feasible, depending on your requirements, and I'd certainly=
 respect that.  But, if you're looking at old examples and that is what's m=
otivating your question, it's good to know about the other options availabl=
e.

There's also soft commits and NRT gets, also interesting reading.

--
Mark Bennett / LucidWorks: Search & Big Data / mark.bennett@lucidworks.com
Office: 408-898-4201 / Telecommute: 408-733-0387 / Cell: 408-829-6513

On Jun 4, 2013, at 3:50 PM, Renata Vaccaro <renata@emailtopia.com> wrote:

> Hi all,
>=20
>=20
>=20
> I'm new to this list and hoping I'm asking this question in the correct
> place.  I upgraded lucene from a very, very old version to version
> 4.2.1.  I'm finding that calling IndexWriter.commit() is much slower
> than the previous IndexWriter.close() that I was calling with the old
> lucene (that didn't have a commit call).  It's taking 500ms-1s where
> previously the close call was taking about 50ms.  I call commit every
> time I add a document.  I am creating the IndexWriter as follows:
>=20
>=20
>=20
> Directory dir =3D FSDirectory.open(index);
>=20
>      Analyzer analyzer =3D new MsStandardAnalyzer();
>=20
>      IndexWriterConfig iwc =3D new IndexWriterConfig(Version.LUCENE_42,
> analyzer);
>=20
>      iwc.setOpenMode(OpenMode.CREATE_OR_APPEND);
>=20
>      iwc.setRAMBufferSizeMB(256.0);
>=20
> IndexWriter writer =3D new IndexWriter(dir, iwc);
>=20
>=20
>=20
> Is there something that I can do to make the commit call faster?
>=20