Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 32393 invoked from network); 11 Feb 2009 23:24:05 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 11 Feb 2009 23:24:05 -0000 Received: (qmail 95270 invoked by uid 500); 11 Feb 2009 23:23:58 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 95237 invoked by uid 500); 11 Feb 2009 23:23:58 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 95226 invoked by uid 99); 11 Feb 2009 23:23:58 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Feb 2009 15:23:58 -0800 X-ASF-Spam-Status: No, hits=4.0 required=10.0 tests=DNS_FROM_OPENWHOIS,FORGED_YAHOO_RCVD,SPF_HELO_PASS,SPF_PASS,WHOIS_MYPRIVREG X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of lists@nabble.com designates 216.139.236.158 as permitted sender) Received: from [216.139.236.158] (HELO kuber.nabble.com) (216.139.236.158) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Feb 2009 23:23:50 +0000 Received: from isper.nabble.com ([192.168.236.156]) by kuber.nabble.com with esmtp (Exim 4.63) (envelope-from ) id 1LXOQT-0002LI-Py for java-user@lucene.apache.org; Wed, 11 Feb 2009 15:23:29 -0800 Message-ID: <21966759.post@talk.nabble.com> Date: Wed, 11 Feb 2009 15:23:29 -0800 (PST) From: Qingdi To: java-user@lucene.apache.org Subject: optimization problem MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Nabble-From: liuqingdi@yahoo.com X-Virus-Checked: Checked by ClamAV on apache.org (I posted this question to "solr user" forum, but didn't get a clear answer. So re-post it here.) Our index size is about 60G. Most of the time, the optimization works fine. But this morning, the optimization kept creating new segment files until all the free disk space (300G) was used up. Here is how the files generated during optimization look like: ============================================ .................................... -rw-r--r-- 1 root root 213464 Feb 10 07:33 _5w9a.tis -rw-r--r-- 1 root root 3039 Feb 10 07:33 _5w9a.tii -rw-r--r-- 1 root root 9360 Feb 10 07:33 _5w9a.prx -rw-r--r-- 1 root root 19824 Feb 10 07:33 _5w9a.frq -rw-r--r-- 1 root root 27 Feb 10 07:33 _5w9a.fnm -rw-r--r-- 1 root root 74884 Feb 10 07:33 _5w9a.fdx -rw-r--r-- 1 root root 3753944 Feb 10 07:33 _5w9a.fdt -rw-r--r-- 1 root root 212513 Feb 10 07:33 _5w99.tis -rw-r--r-- 1 root root 3005 Feb 10 07:33 _5w99.tii -rw-r--r-- 1 root root 9436 Feb 10 07:33 _5w99.prx -rw-r--r-- 1 root root 20052 Feb 10 07:33 _5w99.frq -rw-r--r-- 1 root root 27 Feb 10 07:33 _5w99.fnm -rw-r--r-- 1 root root 75492 Feb 10 07:33 _5w99.fdx -rw-r--r-- 1 root root 3795439 Feb 10 07:33 _5w99.fdt -rw-r--r-- 1 root root 215726 Feb 10 07:33 _5w98.tis -rw-r--r-- 1 root root 2994 Feb 10 07:33 _5w98.tii -rw-r--r-- 1 root root 9438 Feb 10 07:33 _5w98.prx -rw-r--r-- 1 root root 20058 Feb 10 07:33 _5w98.frq -rw-r--r-- 1 root root 27 Feb 10 07:33 _5w98.fnm -rw-r--r-- 1 root root 75508 Feb 10 07:33 _5w98.fdx -rw-r--r-- 1 root root 3779402 Feb 10 07:33 _5w98.fdt .................................... ============================================ This is the third time we encountered this issue. Any idea why the optimization keeps creating new files? (If we restart the solr server and run optimization again, the index files can be recovered. we are on solr 1.3.) Where could we find more info. about how the optimization process work? Appreciate your help. Qingdi -- View this message in context: http://www.nabble.com/optimization-problem-tp21966759p21966759.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org