Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 64407 invoked from network); 13 Apr 2010 19:29:41 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 13 Apr 2010 19:29:41 -0000 Received: (qmail 57927 invoked by uid 500); 13 Apr 2010 19:29:39 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 57886 invoked by uid 500); 13 Apr 2010 19:29:39 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 57878 invoked by uid 99); 13 Apr 2010 19:29:39 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Apr 2010 19:29:39 +0000 X-ASF-Spam-Status: No, hits=0.3 required=10.0 tests=AWL,MIME_BASE64_BLANKS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [198.147.195.5] (HELO flicker.bmc.com) (198.147.195.5) by apache.org (qpsmtpd/0.29) with SMTP; Tue, 13 Apr 2010 19:29:34 +0000 Received: by flicker.bmc.com (Postfix, from userid 13749) id A5A771E685E; Tue, 13 Apr 2010 12:29:13 -0700 (MST) Received: from PHX-HTPRD-01.adprod.bmc.com (phx-htprd-01.adprod.bmc.com [172.24.32.7]) by flicker.bmc.com (Postfix) with ESMTP id 9E9311E682B for ; Tue, 13 Apr 2010 12:29:13 -0700 (MST) Received: from PHXCCRPRD02.adprod.bmc.com ([172.24.32.181]) by PHX-HTPRD-01.adprod.bmc.com ([172.24.32.7]) with mapi; Tue, 13 Apr 2010 13:29:13 -0600 From: "Woolf, Ross" To: "java-user@lucene.apache.org" Date: Tue, 13 Apr 2010 13:29:07 -0600 Subject: RE: IndexWriter and memory usage Thread-Topic: IndexWriter and memory usage Thread-Index: AcrawKViZg0lVA9pTuOcXsESjGcqRgAfjQ9w Message-ID: <492379B6AA909E4FAF672AACCA0EADC25CBAA42B46@PHXCCRPRD02.adprod.bmc.com> References: <492379B6AA909E4FAF672AACCA0EADC24A40EE9B10@PHXCCRPRD02.adprod.bmc.com> <492379B6AA909E4FAF672AACCA0EADC24A40EE9E3D@PHXCCRPRD02.adprod.bmc.com> <492379B6AA909E4FAF672AACCA0EADC25CBA2EDD34@PHXCCRPRD02.adprod.bmc.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 QXJlIHRoZXNlIGZpeGVzIGluIDIuOXggYnJhbmNoPyAgV2UgYXJlIHVzaW5nIDIuOXggYW5kIGNh bid0IG1vdmUgdG8gM3gganVzdCB5ZXQuICBJZiBzbywgd2hlcmUgZG8gSSBzcGVjaWZpY2FsbHkg cGljayB0aGlzIHVwIGZyb20/DQoNCi0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQpGcm9tOiBM YW5jZSBOb3Jza29nIFttYWlsdG86Z29rc3JvbkBnbWFpbC5jb21dIA0KU2VudDogTW9uZGF5LCBB cHJpbCAxMiwgMjAxMCAxMDoyMCBQTQ0KVG86IGphdmEtdXNlckBsdWNlbmUuYXBhY2hlLm9yZw0K U3ViamVjdDogUmU6IEluZGV4V3JpdGVyIGFuZCBtZW1vcnkgdXNhZ2UNCg0KVGhlcmUgaXMgc29t ZSBidWdzIHdoZXJlIHRoZSB3cml0ZXIgZGF0YSBzdHJ1Y3R1cmVzIHJldGFpbiBkYXRhIGFmdGVy DQppdCBpcyBmbHVzaGVkLiBUaGV5IGFyZSBjb21taXR0ZWQgYXMgb2YgbWF5YmUgdGhlIHBhc3Qg d2Vlay4gSWYgeW91DQpjYW4gcHVsbCB0aGUgdHJ1bmsgYW5kIHRyeSBpdCB3aXRoIHlvdXIgdXNl IGNhc2UsIHRoYXQgd291bGQgYmUgZ3JlYXQuDQoNCk9uIE1vbiwgQXByIDEyLCAyMDEwIGF0IDg6 NTQgQU0sIFdvb2xmLCBSb3NzIDxSb3NzX1dvb2xmQGJtYy5jb20+IHdyb3RlOg0KPiBJIHdhcyBv biB2YWNhdGlvbiBsYXN0IHdlZWsgc28ganVzdCBnZXR0aW5nIGJhY2sgdG8gdGhpcy4uLiDCoEhl cmUgaXMgdGhlIGluZm8gc3RyZWFtIChhcyBhbiBhdHRhY2htZW50KS4gwqBJJ2xsIHNlZSB3aGF0 IEkgY2FuIGRvIGFib3V0IHJlZHVjaW5nIHRoZSBoZWFwIGR1bXAgKEl0IHdhcyBzdXBwbGllZCBi eSBhIGNvbGxlYWd1ZSkuDQo+DQo+DQo+IC0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQo+IEZy b206IE1pY2hhZWwgTWNDYW5kbGVzcyBbbWFpbHRvOmx1Y2VuZUBtaWtlbWNjYW5kbGVzcy5jb21d DQo+IFNlbnQ6IFNhdHVyZGF5LCBBcHJpbCAwMywgMjAxMCAzOjM5IEFNDQo+IFRvOiBqYXZhLXVz ZXJAbHVjZW5lLmFwYWNoZS5vcmcNCj4gU3ViamVjdDogUmU6IEluZGV4V3JpdGVyIGFuZCBtZW1v cnkgdXNhZ2UNCj4NCj4gSG1tIHdoeSBpcyB0aGUgaGVhcCBkdW1wIHNvIGltbWVuc2U/IMKgTm9y bWFsbHkgaXQgY29udGFpbnMgdGhlIHRvcCBODQo+IChlZyAxMDApIG9iamVjdCB0eXBlcyBhbmQg dGhlaXIgY291bnQvYWdncmVnYXRlIFJBTSB1c2FnZS4NCj4NCj4gQ2FuIHlvdSBhdHRhY2ggdGhl IGluZm9TdHJlYW0gb3V0cHV0IHRvIGFuIGVtYWlsICh0byBqYXZhLXVzZXIpPw0KPg0KPiBNaWtl DQo+DQo+IE9uIEZyaSwgQXByIDIsIDIwMTAgYXQgNToyOCBQTSwgV29vbGYsIFJvc3MgPFJvc3Nf V29vbGZAYm1jLmNvbT4gd3JvdGU6DQo+PiBJIGhhdmUgdGhpcyBhbmQgdGhlIGhlYXAgZHVtcCBp cyA2M21iIHppcHBlZC4gwqBUaGUgaW5mbyBzdHJlYW0gaXMgbXVjaCBzbWFsbGVyICgzMSBrYiB6 aXBwZWQpLCBidXQgSSBkb24ndCBrbm93IGhvdyB0byBnZXQgdGhlbSB0byB5b3UuDQo+Pg0KPj4g V2UgYXJlIG5vdCB1c2luZyB0aGUgTlJUIHJlYWRlcnMNCj4+DQo+PiAtLS0tLU9yaWdpbmFsIE1l c3NhZ2UtLS0tLQ0KPj4gRnJvbTogTWljaGFlbCBNY0NhbmRsZXNzIFttYWlsdG86bHVjZW5lQG1p a2VtY2NhbmRsZXNzLmNvbV0NCj4+IFNlbnQ6IFRodXJzZGF5LCBBcHJpbCAwMSwgMjAxMCA1OjIx IFBNDQo+PiBUbzogamF2YS11c2VyQGx1Y2VuZS5hcGFjaGUub3JnDQo+PiBTdWJqZWN0OiBSZTog SW5kZXhXcml0ZXIgYW5kIG1lbW9yeSB1c2FnZQ0KPj4NCj4+IEhtbSwgbm90IGdvb2QuIMKgQ2Fu IHlvdSBwb3N0IGEgaGVhcCBkdW1wPyDCoEFsc28sIGNhbiB5b3UgdHVybiBvbg0KPj4gaW5mb1N0 cmVhbSwgaW5kZXggdXAgdG8gdGhlIE9PTSBAIDUxMiBNQiwgYW5kIHBvc3QgdGhlIG91dHB1dD8N Cj4+DQo+PiBJbmRleFdyaXRlciBzaG91bGQgbm90IGhhbmcgb250byBtdWNoIGJleW9uZCB0aGUg UkFNIGJ1ZmZlci4gwqBCdXQsIGl0DQo+PiBkb2VzIGFsbG9jYXRlIGFuZCB0aGVuIHJlY3ljbGUg dGhpcyBSQU0gYnVmZmVyLCBzbyBldmVuIGluIGFuIGlkbGUNCj4+IHN0YXRlIChoYXZpbmcgaW5k ZXhlZCBlbm91Z2ggZG9jcyB0byBmaWxsIHVwIHRoZSBSQU0gYnVmZmVyIGF0IGxlYXN0DQo+PiBv bmNlKSBpdCdsbCBob2xkIG9udG8gdGhvc2UgMTYgTUIuDQo+Pg0KPj4gQXJlIHlvdSB1c2luZyBn ZXRSZWFkZXIgKHRvIGdldCB5b3VyIE5SVCByZWFkZXJzKT8gwqBJZiBzbywgYXJlIHlvdQ0KPj4g cmVhbGx5IHN1cmUgeW91J3JlIGV2ZW50dWFsbHkgY2xvc2luZyB0aGUgcHJldmlvdXMgcmVhZGVy IGFmdGVyDQo+PiBvcGVuaW5nIGEgbmV3IG9uZT8NCj4+DQo+PiBNaWtlDQo+Pg0KPj4gT24gVGh1 LCBBcHIgMSwgMjAxMCBhdCA2OjU4IFBNLCBXb29sZiwgUm9zcyA8Um9zc19Xb29sZkBibWMuY29t PiB3cm90ZToNCj4+PiBXZSBhcmUgc2VlaW5nIGEgc2l0dWF0aW9uIHdoZXJlIHRoZSBJbmRleFdy aXRlciBpcyB1c2luZyB1cCB0aGUgSmF2YSBIZWFwIHNwYWNlIGFuZCBvbmx5IHJlbGVhc2VzIG1l bW9yeSBmb3IgZ2FyYmFnZSBjb2xsZWN0aW9uIHVwb24gYSBjb21taXQuIMKgIFdlIGFyZSB1c2lu ZyB0aGUgZGVmYXVsdCBSQU1CdWZmZXJTaXplIG9mIDE2IG1iLiDCoFdlIGFyZSB1c2luZyBMdWNl bmUgMi45LjEuIFdlIGFyZSBzZXQgYXQgaGVhcCBzaXplIG9mIDUxMiBtYi4NCj4+Pg0KPj4+IFdl IGhhdmUgYSBsYXJnZSBudW1iZXIgb2YgZG9jdW1lbnRzIHRoYXQgYXJlIHJ1biB0aHJvdWdoIFRp a2EgYW5kIHRoZW4gYWRkZWQgdG8gdGhlIGluZGV4LiDCoFRoZSBkYXRhIGZyb20gVGlrYSBpcyBj aGFuZ2VkIHRvIGEgc3RyaW5nLCBhbmQgdGhlbiBzZW50IHRvIEx1Y2VuZS4gwqBIZWFwIGR1bXBz IGNsZWFybHkgc2hvdyB0aGUgZGF0YSBpbiB0aGUgTHVjZW5lIGNsYXNzZXMgYW5kIG5vdCBpbiBU aWthLiDCoE91ciBpbnRlbnQgaXMgdG8gb25seSBwZXJmb3JtIGEgY29tbWl0IG9uY2UgdGhlIGVu dGlyZSBpbmRleGluZyBydW4gaXMgY29tcGxldGUsIGJ1dCBzZXZlcmFsIGhvdXJzIGludG8gdGhl IHByb2Nlc3MgZXZlcnl0aGluZyBjb21lcyB0byBhIGNyYXdsLiDCoEluIHVzaW5nIGJvdGggSkNv bnNvbGUgYW5kIFZpc3VhbFZNIMKgd2UgY2FuIHNlZSB0aGF0IHRoZSBoZWFwIHNwYWNlIGlzIG1h eGVkIG91dCBhbmQgZ2FyYmFnZSBjb2xsZWN0aW9uIGlzIG5vdCBhYmxlIHRvIGNsZWFuIHVwIGFu eSBtZW1vcnkgb25jZSB3ZSBnZXQgaW50byB0aGlzIHN0YXRlLiDCoEl0IGlzIG91ciB1bmRlcnN0 YW5kaW5nIHRoYXQgdGhlIEluZGV4V3JpdGVyIHNob3VsZCBiZSBvbmx5IGhvbGRpbmcgb250byAx NiBtYiBvZiBkYXRhIGJlZm9yZSBpdCBmbHVzaGVzIGl0LCBidXQgd2hhdCB3ZSBhcmUgc2VlaW5n IGlzIHRoYXQgd2hpbGUgaXQgaXMgaW4gZmFjdCB3cml0aW5nIGRhdGEgdG8gZGlzayB3aGVuIGl0 IGhpdHMgdGhlIDE2IG1iIGxpbWl0LCBpdCBpcyBhbHNvIGhvbGRpbmcgb250byBzb21lIGRhdGEg aW4gbWVtb3J5IGFuZCBub3QgYWxsb3dpbmcgZ2FyYmFnZSBjb2xsZWN0aW9uIHRvIHRha2UgcGxh Y2UsIGFuZCB0aGlzIGNvbnRpbnVlcyB1bnRpbCBnYXJiYWdlIGNvbGxlY3Rpb24gaXMgdW5hYmxl IHRvIGZyZWUgdXAgZW5vdWdoIHNwYWNlIHRvIGFsbCB0aGluZ3MgdG8gbW92ZSBmYXN0ZXIgdGhh biBhIGNyYXdsLg0KPj4+DQo+Pj4gQXMgYSB0ZXN0IHdlIGNhdXNlZCBhIGNvbW1pdCB0byBvY2N1 ciBhZnRlciBlYWNoIGRvY3VtZW50IGlzIGluZGV4ZWQgYW5kIHdlIHNlZSB0aGUgdG90YWwgYW1v dW50IG9mIG1lbW9yeSByZWR1Y2VkIGZyb20gbmVhcmx5IDEwMCUgb2YgdGhlIEphdmEgSGVhcCB0 byBhcm91bmQgNzAtNzUlLiDCoFRoZSBwcm9maWxpbmcgdG9vbHMgbm93IHNob3cgdGhhdCB0aGUg bWVtb3J5IGlzIGNsZWFuZWQgdXAgdG8gc29tZSBleHRlbnQgYWZ0ZXIgZWFjaCBkb2N1bWVudC4g wqBCdXQgb2YgY291cnNlIHRoaXMgY29tcGxldGVseSBkZWZlYXRzIHRoZSB3aG9sZSByZWFzb24g d2h5IHdlIHdhbnQgdG8gb25seSBjb21taXQgYXQgdGhlIGVuZCBvZiB0aGUgcnVuIGZvciBwZXJm b3JtYW5jZSBzYWtlLiDCoE1vc3Qgb2YgdGhlIGRhdGEsIGFzIHNlZW4gdXNpbmcgSGVhcCBhbmFs YXNpcywgaXMgaGVsZCBpbiBCeXRlLCBDaGFyYWN0ZXIsIGFuZCBJbnRlZ2VyIGNsYXNzZXMgd2hv cyBHQyByb290cyBhcmUgdGllZCBiYWNrIHRvIHRoZSBXcml0ZXIgT2JqZWN0cyBhbmQgdGhyZWFk cy4gwqBUaGUgaW5zdGFuY2UgY291bnRzLCBhZnRlciBydW5uaW5nIGp1c3QgMSwxMDAgZG9jdW1l bnRzIHNlZW1zIHN0YWdnZXJpbmcNCj4+Pg0KPj4+IElzIHRoZXJlIGFkZGl0aW9uYWwgZGF0YSB0 aGF0IHRoZSBJbmRleFdyaXRlciBoYW5ncyBvbnRvIHJlZ2FyZGxlc3Mgb2Ygd2hlbiBpdCBoaXRz IHRoZSBSQU1CdWZmZXJTaXplIGxpbWl0PyDCoFdoeSBhcmUgd2Ugc2VlaW5nIHRoZSBoZWFwIHNw YWNlIGFsbCBiZWluZyB1c2VkIHVwPw0KPj4+DQo+Pj4gQSBzaWRlIHF1ZXN0aW9uIHRvIHRoaXMg aXMgdGhlIGZhY3QgdGhhdCB3ZSBhbHdheXMgc2VlIGEgbGFyZ2UgYW1vdW50IG9mIG1lbW9yeSB1 c2VkIGJ5IHRoZSBJbmRleFdyaXRlciBldmVuIGFmdGVyIG91ciBpbmRleGluZyBoYXMgYmVlbiBj b21wbGV0ZWQgYW5kIGFsbCBjb21taXRzIGhhdmUgdGFrZW4gcGxhY2UgKGJhc2ljYWxseSBpbiBh biBpZGxlIHN0YXRlKS4gwqBXaHkgd291bGQgdGhpcyBiZT8gwqBJcyB0aGUgb25seSB3YXkgdG8g dG90YWxseSBjbGVhbiB1cCB0aGUgbWVtb3J5IGlzIHRvIGNsb3NlIHRoZSB3cml0ZXI/IMKgT3Vy IGluZGV4IGlzIGFsc28gdXNlZCBmb3IgcmVhbCB0aW1lIGluZGV4aW5nIHNvIHRoZSBJbmRleFdy aXRlciBpcyBpbnRlbmRlZCB0byByZW1haW4gb3BlbiBmb3IgdGhlIGxpZmV0aW1lIG9mIHRoZSBh cHAuDQo+Pj4NCj4+PiBBbnkgaGVscCBpbiB1bmRlcnN0YW5kaW5nIHdoeSB0aGUgSW5kZXhXcml0 ZXIgaXMgbWF4aW5nIG91dCBvdXIgaGVhcCBzcGFjZSBvciB3aGF0IGlzIGV4cGVjdGVkIGZyb20g bWVtb3J5IHVzYWdlIG9mIHRoZSBJbmRleFdyaXRlciB3b3VsZCBiZSBhcHByZWNpYXRlZC4NCj4+ Pg0KPj4NCj4+IC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLQ0KPj4gVG8gdW5zdWJzY3JpYmUsIGUtbWFpbDogamF2YS11 c2VyLXVuc3Vic2NyaWJlQGx1Y2VuZS5hcGFjaGUub3JnDQo+PiBGb3IgYWRkaXRpb25hbCBjb21t YW5kcywgZS1tYWlsOiBqYXZhLXVzZXItaGVscEBsdWNlbmUuYXBhY2hlLm9yZw0KPj4NCj4+DQo+ PiAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0NCj4+IFRvIHVuc3Vic2NyaWJlLCBlLW1haWw6IGphdmEtdXNlci11bnN1 YnNjcmliZUBsdWNlbmUuYXBhY2hlLm9yZw0KPj4gRm9yIGFkZGl0aW9uYWwgY29tbWFuZHMsIGUt bWFpbDogamF2YS11c2VyLWhlbHBAbHVjZW5lLmFwYWNoZS5vcmcNCj4+DQo+Pg0KPg0KPiAtLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0NCj4gVG8gdW5zdWJzY3JpYmUsIGUtbWFpbDogamF2YS11c2VyLXVuc3Vic2NyaWJl QGx1Y2VuZS5hcGFjaGUub3JnDQo+IEZvciBhZGRpdGlvbmFsIGNvbW1hbmRzLCBlLW1haWw6IGph dmEtdXNlci1oZWxwQGx1Y2VuZS5hcGFjaGUub3JnDQo+DQo+DQo+DQo+IC0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQ0K PiBUbyB1bnN1YnNjcmliZSwgZS1tYWlsOiBqYXZhLXVzZXItdW5zdWJzY3JpYmVAbHVjZW5lLmFw YWNoZS5vcmcNCj4gRm9yIGFkZGl0aW9uYWwgY29tbWFuZHMsIGUtbWFpbDogamF2YS11c2VyLWhl bHBAbHVjZW5lLmFwYWNoZS5vcmcNCj4NCg0KDQoNCi0tIA0KTGFuY2UgTm9yc2tvZw0KZ29rc3Jv bkBnbWFpbC5jb20NCg0KLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tDQpUbyB1bnN1YnNjcmliZSwgZS1tYWlsOiBqYXZh LXVzZXItdW5zdWJzY3JpYmVAbHVjZW5lLmFwYWNoZS5vcmcNCkZvciBhZGRpdGlvbmFsIGNvbW1h bmRzLCBlLW1haWw6IGphdmEtdXNlci1oZWxwQGx1Y2VuZS5hcGFjaGUub3JnDQoNCg==