From java-user-return-52133-apmail-lucene-java-user-archive=lucene.apache.org@lucene.apache.org Sun Feb 19 14:22:18 2012 Return-Path: X-Original-To: apmail-lucene-java-user-archive@www.apache.org Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8FAC69917 for ; Sun, 19 Feb 2012 14:22:18 +0000 (UTC) Received: (qmail 25426 invoked by uid 500); 19 Feb 2012 14:22:16 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 25384 invoked by uid 500); 19 Feb 2012 14:22:16 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 25375 invoked by uid 99); 19 Feb 2012 14:22:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Feb 2012 14:22:16 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of bimargulies@gmail.com designates 74.125.82.176 as permitted sender) Received: from [74.125.82.176] (HELO mail-we0-f176.google.com) (74.125.82.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Feb 2012 14:22:10 +0000 Received: by werf1 with SMTP id f1so3792901wer.35 for ; Sun, 19 Feb 2012 06:21:48 -0800 (PST) Received-SPF: pass (google.com: domain of bimargulies@gmail.com designates 10.180.101.200 as permitted sender) client-ip=10.180.101.200; Authentication-Results: mr.google.com; spf=pass (google.com: domain of bimargulies@gmail.com designates 10.180.101.200 as permitted sender) smtp.mail=bimargulies@gmail.com; dkim=pass header.i=bimargulies@gmail.com Received: from mr.google.com ([10.180.101.200]) by 10.180.101.200 with SMTP id fi8mr9941736wib.20.1329661308965 (num_hops = 1); Sun, 19 Feb 2012 06:21:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; bh=u59L8n6k52MoMhPBREFyEwWP/EaQYXghKwkVlwa8Svo=; b=BUE694QlHj4XR1oDzaXG3MRpK0Nl176uGkagr1lcqvMOx4/5nADFbZmqRcNEpL0/Wl v7g19fZ7N1F1ddugZYujDxDoylRDBtzgJ1yHMsgDBFIQRrQnymlE2SDrOa/I8QhsYKu5 hkqqm6+QDvinraDIJysVNur05VOqhmDpw5y0U= MIME-Version: 1.0 Received: by 10.180.101.200 with SMTP id fi8mr8354295wib.20.1329661308890; Sun, 19 Feb 2012 06:21:48 -0800 (PST) Received: by 10.180.85.37 with HTTP; Sun, 19 Feb 2012 06:21:48 -0800 (PST) Date: Sun, 19 Feb 2012 09:21:48 -0500 Message-ID: Subject: Counting all the hits with parallel searching From: Benson Margulies To: java-user@lucene.apache.org Content-Type: text/plain; charset=UTF-8 If I have a lot of segments, and an executor service in my searcher, the following runs out of memory instantly, building giant heaps. Is there another way to express this? Should I file a JIRA that the parallel code should have some graceful behavior? int longestMentionFreq = searcher.search(longestMentionQuery, filter, Integer.MAX_VALUE).totalHits + 1; --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org