Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 44714 invoked from network); 14 Aug 2010 10:14:38 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 14 Aug 2010 10:14:38 -0000 Received: (qmail 89353 invoked by uid 500); 14 Aug 2010 10:14:36 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 89210 invoked by uid 500); 14 Aug 2010 10:14:33 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 89202 invoked by uid 99); 14 Aug 2010 10:14:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 14 Aug 2010 10:14:32 +0000 X-ASF-Spam-Status: No, hits=0.7 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [85.25.71.29] (HELO mail.troja.net) (85.25.71.29) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 14 Aug 2010 10:14:25 +0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by mail.troja.net (Postfix) with ESMTP id B850A45E757 for ; Sat, 14 Aug 2010 12:14:04 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mail.troja.net Received: from mail.troja.net ([127.0.0.1]) by localhost (megaira.troja.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id m0J-t2ikWUPx for ; Sat, 14 Aug 2010 12:13:50 +0200 (CEST) Received: from VEGA (dslb-088-065-071-010.pools.arcor-ip.net [88.65.71.10]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.troja.net (Postfix) with ESMTPSA id D7D2C45E73D for ; Sat, 14 Aug 2010 12:13:49 +0200 (CEST) From: "Uwe Schindler" To: References: In-Reply-To: Subject: RE: 140GB index directory, what can I do? Date: Sat, 14 Aug 2010 12:15:02 +0200 Message-ID: <000101cb3b99$8f592410$ae0b6c30$@thetaphi.de> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 14.0 Thread-Index: AQHazRbdffq2LoHDxqNsOngAgKS2lZLBmMhA Content-Language: de X-Virus-Checked: Checked by ClamAV on apache.org Optimize the index one time then all unused segment files are *for-sure* removed. ----- Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: uwe@thetaphi.de > -----Original Message----- > From: Andrew Bruno [mailto:andrew.bruno@gmail.com] > Sent: Saturday, August 14, 2010 12:11 PM > To: java-user@lucene.apache.org > Subject: 140GB index directory, what can I do? > > Hi all, > > I have an index directory that is growing pretty fast, and is now at 138GB. > > A while ago, this index got corrupted. It was rebuilt, but the engineer cannot > remember whether he deleted the corrupt directory before the rebuild. Is > there a way to know if any files are not being used or whether they can be > purged, merged, etc? > > The files are listed below. > > 08/14/2010 02:51 AM .. > 03/24/2010 11:22 PM 0 clearcache > 08/14/2010 02:51 AM 4 deletable > 08/14/2010 02:51 AM 369 segments > 03/29/2010 02:29 AM 135,941,156,712 _1x3.cfs > 08/13/2010 08:24 AM 275,615 _1x3.del > 05/10/2010 09:59 AM 977,999,933 _491b.cfs > 08/10/2010 12:46 PM 17,304 _491b.del > 06/18/2010 09:33 PM 809,473,470 _7sr7.cfs > 08/06/2010 07:10 AM 15,038 _7sr7.del > 07/23/2010 11:34 PM 559,421,479 _aeps.cfs > 08/13/2010 07:20 AM 11,276 _aeps.del > 08/09/2010 09:23 AM 299,717,058 _bu0l.cfs > 08/12/2010 12:42 PM 6,387 _bu0l.del > 08/11/2010 02:46 PM 66,910,259 _c4x4.cfs > 08/11/2010 04:06 PM 1,401 _c4x4.del > 08/13/2010 02:11 PM 45,009,744 _cc9c.cfs > 08/13/2010 03:59 PM 944 _cc9c.del > 08/13/2010 04:03 PM 3,409,701 _ccqa.cfs > 08/13/2010 04:29 PM 79 _ccqa.del > 08/13/2010 10:42 PM 900,521 _ccvl.cfs > 08/14/2010 12:01 AM 29 _ccvl.del > 08/14/2010 12:00 AM 589,015 _cczi.cfs > 08/14/2010 12:07 AM 24 _cczi.del > 08/14/2010 12:05 AM 260,231 _cd0v.cfs > 08/14/2010 02:44 AM 324,498 _cd1z.cfs > 08/14/2010 02:44 AM 10,651 _cd20.cfs > 08/14/2010 02:45 AM 6,427 _cd21.cfs > 08/14/2010 02:45 AM 6,702 _cd22.cfs > 08/14/2010 02:45 AM 9,024 _cd23.cfs > 08/14/2010 02:45 AM 10,641 _cd24.cfs > 08/14/2010 02:46 AM 9,037 _cd25.cfs > 08/14/2010 02:46 AM 6,297 _cd26.cfs > 08/14/2010 02:46 AM 6,504 _cd27.cfs > 08/14/2010 02:46 AM 56,164 _cd28.cfs > 08/14/2010 02:47 AM 9 _cd28.del > 08/14/2010 02:47 AM 56,246 _cd29.cfs > 08/14/2010 02:47 AM 7,093 _cd2a.cfs > 08/14/2010 02:47 AM 9 _cd2a.del > 08/14/2010 02:47 AM 7,179 _cd2b.cfs > 08/14/2010 02:48 AM 10,324 _cd2c.cfs > 08/14/2010 02:48 AM 9 _cd2c.del > 08/14/2010 02:48 AM 10,412 _cd2d.cfs > 08/14/2010 02:49 AM 67,808 _cd2e.cfs > 08/14/2010 02:49 AM 6,431 _cd2f.cfs > 08/14/2010 02:49 AM 6,419 _cd2g.cfs > 08/14/2010 02:49 AM 10,394 _cd2h.cfs > 08/14/2010 02:49 AM 10,417 _cd2i.cfs > 08/14/2010 02:49 AM 8,379 _cd2j.cfs > 08/14/2010 02:50 AM 5,982 _cd2k.cfs > 08/14/2010 02:50 AM 5,670 _cd2l.cfs > 08/14/2010 02:51 AM 5,622 _cd2m.cfs > 51 File(s) 138,705,840,941 bytes > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org