Return-Path: X-Original-To: apmail-lucene-java-user-archive@www.apache.org Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8124410D5C for ; Fri, 20 Dec 2013 17:59:39 +0000 (UTC) Received: (qmail 53112 invoked by uid 500); 20 Dec 2013 17:55:39 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 52718 invoked by uid 500); 20 Dec 2013 17:54:33 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 52540 invoked by uid 99); 20 Dec 2013 17:54:07 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Dec 2013 17:54:07 +0000 X-ASF-Spam-Status: No, hits=0.6 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [74.125.82.52] (HELO mail-wg0-f52.google.com) (74.125.82.52) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Dec 2013 17:54:02 +0000 Received: by mail-wg0-f52.google.com with SMTP id x13so2816370wgg.7 for ; Fri, 20 Dec 2013 09:53:41 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=cYmjwwz5G5drmhxFSZBYTW60PNlG1NNsFmiVgCYNeSI=; b=Fd/raY9Vy1kpPeHhvTGd4Ihn1dUgNflaL42Sh3yDF7db46xuzkBHnQeyreJUX59H8S 8X8AbHmNB/xCxyB7fU+LGyj25SmXqNwmDYffFL0qvbddnFG6WwcEjGHyEaKcVT59lN5R LitWvJ0LKHADvXjqEsTzTjqyT1Kfw4Woc1H5EMEBBlcU1vxMQfIInnBZOX9t9atBMwvV DrFfq290isRbNuGCeKKJkmUHOUl2USI1XAm+rbDVFrzihMZdf+H3DbkSBQ4ZL3AK+ruk Vm29Yg/Zcir01zTKhj2I0lBpI9lPRqbFGeoWt7sq13fRTIwH4xEXXNIi0s2dmV07FlrB BNDQ== X-Gm-Message-State: ALoCoQn00WUC1mfGN4wJ5oL3fb+VsTit1EwNzUroXMNcgbzofejtG90hoyymJqcvd7JPKxpNTwc2 X-Received: by 10.180.86.198 with SMTP id r6mr8804011wiz.27.1387562021414; Fri, 20 Dec 2013 09:53:41 -0800 (PST) MIME-Version: 1.0 Received: by 10.227.8.202 with HTTP; Fri, 20 Dec 2013 09:53:21 -0800 (PST) In-Reply-To: <1387519802550-4107540.post@n3.nabble.com> References: <1387519802550-4107540.post@n3.nabble.com> From: Michael McCandless Date: Fri, 20 Dec 2013 12:53:21 -0500 Message-ID: Subject: Re: Lucene Search and Disk I/O To: Lucene Users Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org The situation is pretty much the same as before, just different file names :) Lucene pre-loads certain "hot" structures into RAM: the terms index (.tip files), deleted documents (.del files), norms, etc. For all other files, it relies on the OS to cache any hot pages in its buffer/IO cache, and it typically reads sequentially so OS readahead should work well. Mike McCandless http://blog.mikemccandless.com On Fri, Dec 20, 2013 at 1:10 AM, wactioner wrote: > I had a similar question posted here > > a few years earlier. > > How does a lucene search handle disk I/O and reading from index files? I'm > not sure how much the previous answer stands true. I notice that some of the > index files referenced in the last answer (.tii files) don't exist anymore, > unless .tii files were renamed to .tip. > > If anyone is familiar with the matter on this board, could you comment on > how ElasticSearch shards these files? Any thoughts would be appreciated. > Thank you! > > > > > -- > View this message in context: http://lucene.472066.n3.nabble.com/Lucene-Search-and-Disk-I-O-tp4107540.html > Sent from the Lucene - Java Users mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org