Return-Path: X-Original-To: apmail-lucene-java-user-archive@www.apache.org Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 748E4F288 for ; Tue, 2 Apr 2013 16:44:53 +0000 (UTC) Received: (qmail 45016 invoked by uid 500); 2 Apr 2013 16:44:51 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 44606 invoked by uid 500); 2 Apr 2013 16:44:50 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 44571 invoked by uid 99); 2 Apr 2013 16:44:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Apr 2013 16:44:49 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jpountz@gmail.com designates 209.85.214.54 as permitted sender) Received: from [209.85.214.54] (HELO mail-bk0-f54.google.com) (209.85.214.54) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Apr 2013 16:44:44 +0000 Received: by mail-bk0-f54.google.com with SMTP id q16so320196bkw.41 for ; Tue, 02 Apr 2013 09:44:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=kcQzZJjFgCLQ3AmtA+DhSjUR1j2NVzcJtQUJiFMZBow=; b=Gy6KAuL5p3ERW4wVnhiTMX0UM+6YrzWJNj1ePayrrr6kUrzZ2foUkoK55DgXaXYCpp JRk2Y5VbyowQrL+io8WWhET6UtlevGSKBLtt+tZFvDCEMDY9IcgkWDteO5EBeVJKimer JSnFoGb0xcERR0lbGVVFyjCxA56Pnxun+8565g0L6S3SFfzrcW28b9Vfd/L0eMnIsF8M u50aHt217fEA5LE9YGiTLR34Lf2+S/7zXXiw1VrgZSD0/HQWyPqQ8ph8G3QZKWHeht0f oJd2og/1vWUM6juZJmJRSUeFWTW3ZvJ5Z1tDUp5pB87QR+JyFPtxoLZ63k9+gSgXIGBE JciQ== X-Received: by 10.205.3.68 with SMTP id nx4mr6992475bkb.139.1364921063405; Tue, 02 Apr 2013 09:44:23 -0700 (PDT) MIME-Version: 1.0 Received: by 10.204.32.85 with HTTP; Tue, 2 Apr 2013 09:44:03 -0700 (PDT) In-Reply-To: <801364913572@webcorp2g.yandex-team.ru> References: <91551364905770@webcorp2g.yandex-team.ru> <801364913572@webcorp2g.yandex-team.ru> From: Adrien Grand Date: Tue, 2 Apr 2013 18:44:03 +0200 Message-ID: Subject: Re: How to use concurrency efficiently To: java-user@lucene.apache.org Content-Type: text/plain; charset=UTF-8 X-Virus-Checked: Checked by ClamAV on apache.org On Tue, Apr 2, 2013 at 4:39 PM, Igor Shalyminov wrote: > Yes, the number of documents is not too large (about 90 000), but the queries are very hard. Although they're just boolean, a typical query can produce a result with tens of millions of hits. How can there be tens of millions of hits with only 90000 docs? > Single-threadedly such a query runs ~20 seconds, which is too slow. therefore, multithreading is vital for this task. Indeed, that's super slow. Multithreading could help a little, but maybe there is something to do to better index your data so that queries get faster? -- Adrien --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org