Return-Path: 
 <solr-user-return-90749-apmail-lucene-solr-user-archive=lucene.apache.org@lucene.apache.org>
X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org
Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 860D9105DB
	for <apmail-lucene-solr-user-archive@minotaur.apache.org>;
 Sun,  8 Sep 2013 15:52:06 +0000 (UTC)
Received: (qmail 99758 invoked by uid 500); 8 Sep 2013 15:52:01 -0000
Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org
Received: (qmail 99626 invoked by uid 500); 8 Sep 2013 15:52:00 -0000
Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:solr-user-help@lucene.apache.org>
List-Unsubscribe: <mailto:solr-user-unsubscribe@lucene.apache.org>
List-Post: <mailto:solr-user@lucene.apache.org>
List-Id: <solr-user.lucene.apache.org>
Reply-To: solr-user@lucene.apache.org
Delivered-To: mailing list solr-user@lucene.apache.org
Received: (qmail 99618 invoked by uid 99); 8 Sep 2013 15:51:58 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 08 Sep 2013 15:51:58 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of idokissos@gmail.com
 designates 209.85.212.181 as permitted sender)
Received: from [209.85.212.181] (HELO mail-wi0-f181.google.com)
 (209.85.212.181)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 08 Sep 2013 15:51:53 +0000
Received: by mail-wi0-f181.google.com with SMTP id ex4so402382wid.8
        for <solr-user@lucene.apache.org>;
 Sun, 08 Sep 2013 08:51:31 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:sender:from:date:message-id:subject:to:content-type;
        bh=V9IrkEG5JRWcLicpV7SMMBJziaikfqHmE9suuqtVokc=;
        b=NJJdjMp1/kcP6AMm0imC7MmkF6H8y55OCgTszsg4KB+saDqPIGtV71q/LigPLGzzJS
         QsPjwdi3FoaYonvfswLZGFIYyWbUFW7SpxKSDffAaKgYC6eUFBZrzyk0Pk9Z/xr1wU99
         nNayGTzHU95TFVbMLlYdT6Okgds15IV+GjEs/tOsh18WHsIXnPhjqX3Jy8fdHXYo0f2w
         Q/rhz/b+jlTByYalrDNvNzZAz2MudU2YzTfg83I6eEOLwD4cdJ1Wovxggvr5vu6MJMxg
         Xr9Ck0oB+U00GdgpTp3UAx4PipGPohPqD+YV0ZZ0s97vYVi+Gz3w+9GYa4gB+h25Ofyw
         BYIA==
X-Received: by 10.180.39.212 with SMTP id r20mr5409606wik.13.1378655491856;
 Sun, 08 Sep 2013 08:51:31 -0700 (PDT)
MIME-Version: 1.0
Sender: idokissos@gmail.com
Received: by 10.194.36.233 with HTTP; Sun, 8 Sep 2013 08:51:01 -0700 (PDT)
From: Manuel Le Normand <manuel.lenormand@gmail.com>
Date: Sun, 8 Sep 2013 18:51:01 +0300
X-Google-Sender-Auth: 5Y11oovP0CIwovLsU664glLhSJQ
Message-ID: 
 <CABGq8w8Pd0knA=MsPPf83ZSS1B2RczN+XoqOPGU0RMsVMyLiJA@mail.gmail.com>
Subject: Expunge deleting using excessive transient disk space
To: "solr-user@lucene.apache.org" <solr-user@lucene.apache.org>
Content-Type: multipart/alternative; boundary=001a11c2b01cdc201104e5e13ee3
X-Virus-Checked: Checked by ClamAV on apache.org

--001a11c2b01cdc201104e5e13ee3
Content-Type: text/plain; charset=ISO-8859-1

  Hi,
In order to delete part of my index I run a delete by query that intends to
erase 15% of the docs.
I added this params to the solrconfig.xml
<mergePolicy class="org.apache.lucene.index.TieredMergePolicy">
   <int name="maxMergeAtOnce">2</int>
   <int name="maxMergeAtOnceExplicit">2</int>
   <double name="maxMergedSegmentMB">5000.0</double>
   <double name="reclaimDeletesWeight">10.0</double>
   <double name="segmentsPerTier">15.0</double>
</mergePolicy>

The extra params were added in order to promote merge of old segments but
with restriction on the transient disk that can be used (as I have only
15GB per shard).

This procedure failed on a no space left on device exception, although
proper calculations show that these params should cause no usage excess of
the transient free disk space I have.
 Looking on the infostream I can see that the first merges do succeed but
older segments are kept in reference thus cannot be deleted until all the
merging are done.

Is there anyway of overcoming this?

--001a11c2b01cdc201104e5e13ee3--