Return-Path: Delivered-To: apmail-lucene-java-dev-archive@www.apache.org Received: (qmail 97026 invoked from network); 29 May 2009 00:19:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 29 May 2009 00:19:45 -0000 Received: (qmail 24952 invoked by uid 500); 29 May 2009 00:19:54 -0000 Delivered-To: apmail-lucene-java-dev-archive@lucene.apache.org Received: (qmail 24894 invoked by uid 500); 29 May 2009 00:19:54 -0000 Mailing-List: contact java-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-dev@lucene.apache.org Delivered-To: mailing list java-dev@lucene.apache.org Received: (qmail 24861 invoked by uid 99); 29 May 2009 00:19:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 May 2009 00:19:54 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jason.rutherglen@gmail.com designates 209.85.217.167 as permitted sender) Received: from [209.85.217.167] (HELO mail-gx0-f167.google.com) (209.85.217.167) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 May 2009 00:19:44 +0000 Received: by gxk11 with SMTP id 11so9741778gxk.5 for ; Thu, 28 May 2009 17:19:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type; bh=Q/zGyZ2an//+WWZ5511Bz9avUod/rByjt1DI5e9+QNM=; b=HMOfWWu/8FC4l8oFo253HDyohe/zl8WuQCC6G7mqP7In7dGlVs69FDX6/vgJ0nb3A7 6x3ZM9N6Lk5ghYO12wtwfLK1haPiFBtmamORpvhHRURdh0FPxBSZOq9kQj4A4yxt4KbN zWNvtHHvfJ/b8OjIXjkOrOfoWrFlcWbpeF1Ng= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=g1PNMkfPCj9r7IuzGAWMv3CI++yTrUO2e+vmmw0btoFThMcu+1zSURdE/uIDFKJXw0 eH9b+pArLVWFoD6+kVLeFTqjiFE5quKAAY4tSva0OV8k9YBOuzlaIaK8RM4kc2mTkuoh /mqINMVxCIJo4onYAWthHRsGh/YXQw3xhJfBw= MIME-Version: 1.0 Received: by 10.150.201.4 with SMTP id y4mr3890143ybf.37.1243556363942; Thu, 28 May 2009 17:19:23 -0700 (PDT) Date: Thu, 28 May 2009 17:19:23 -0700 Message-ID: <85d3c3b60905281719q6b43623fp2b6d9a2ecb954685@mail.gmail.com> Subject: More efficient loading of terms dictionary From: Jason Rutherglen To: java-dev@lucene.apache.org Content-Type: multipart/alternative; boundary=000e0cd4a71854bcca046b0207b6 X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd4a71854bcca046b0207b6 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit This is for Marvin who previously mentioned loading the term dictionary directly from the filesystem (rather than load every Nth term into Java heap) which could improve latency of opening new readers. Were you able to take this idea any further? --000e0cd4a71854bcca046b0207b6 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable This is for Marvin who previously mentioned loading the term
dictionary = directly from the filesystem (rather than load every
Nth term into Java = heap) which could improve latency of opening
new readers.

Were y= ou able to take this idea any further?
--000e0cd4a71854bcca046b0207b6--