Return-Path: X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1C28E175C0 for ; Tue, 28 Oct 2014 13:43:10 +0000 (UTC) Received: (qmail 85381 invoked by uid 500); 28 Oct 2014 13:43:03 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 85306 invoked by uid 500); 28 Oct 2014 13:43:03 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 85294 invoked by uid 99); 28 Oct 2014 13:43:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Oct 2014 13:43:02 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of apache@elyograg.org designates 166.70.79.219 as permitted sender) Received: from [166.70.79.219] (HELO frodo.elyograg.org) (166.70.79.219) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Oct 2014 13:42:36 +0000 Received: from localhost (localhost [127.0.0.1]) by frodo.elyograg.org (Postfix) with ESMTP id BB2937A80 for ; Tue, 28 Oct 2014 07:42:13 -0600 (MDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=elyograg.org; h= content-transfer-encoding:content-type:content-type:in-reply-to :references:subject:subject:mime-version:user-agent:from:from :date:date:message-id:received:received; s=mail; t=1414503733; bh=qkw71Y7BwL5jeVHVDmjLv8NKfEMdP9C5XoQO9nKru9c=; b=Yt2FdqdkMu27 qiY8lze+USZ85aamOj1y5e+vpNq9ZMbOy5XpnArtEA4Qqz/huizyMLOyfT1P8vEC gSWdkGkh440OkmpyGUcNAT1W1imrOdAYzx3sS0RUdm3sKKK0ftV/Bm8UA1dM79E3 IwRw/E1rnzkgWnLxhheaNs9eBKNwbuE= X-Virus-Scanned: Debian amavisd-new at frodo.elyograg.org Received: from frodo.elyograg.org ([127.0.0.1]) by localhost (frodo.elyograg.org [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id h-TSujqtaX1V for ; Tue, 28 Oct 2014 07:42:13 -0600 (MDT) Received: from [192.168.1.102] (102.int.elyograg.org [192.168.1.102]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: elyograg@elyograg.org) by frodo.elyograg.org (Postfix) with ESMTPSA id 6CD2A4F69 for ; Tue, 28 Oct 2014 07:42:13 -0600 (MDT) Message-ID: <544F9D3F.8020100@elyograg.org> Date: Tue, 28 Oct 2014 07:42:23 -0600 From: Shawn Heisey User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: solr-user@lucene.apache.org Subject: Re: Total term frequency in solr includes deleted documents References: <1414502189338-4166288.post@n3.nabble.com> In-Reply-To: <1414502189338-4166288.post@n3.nabble.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org On 10/28/2014 7:16 AM, nutchsolruser wrote: > How can we get exact term frequency with excluding deleted documents term > frequency, and that is without optimization because optimization is > expensive in our case ? > Is there any other way we can get term frequency for entire collection in > solr? This is not possible except through index optimization. Lucene is amazingly efficient at computing information across the entire index. If it were possible to keep that efficiency while also excluding info from deleted documents, I'm sure it would have already been implemented. Thanks, Shawn