From java-user-return-48606-apmail-lucene-java-user-archive=lucene.apache.org@lucene.apache.org Thu Feb 03 08:21:05 2011 Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 11950 invoked from network); 3 Feb 2011 08:21:05 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 3 Feb 2011 08:21:05 -0000 Received: (qmail 89454 invoked by uid 500); 3 Feb 2011 08:21:03 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 89000 invoked by uid 500); 3 Feb 2011 08:20:59 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 88992 invoked by uid 99); 3 Feb 2011 08:20:58 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Feb 2011 08:20:58 +0000 X-ASF-Spam-Status: No, hits=2.8 required=5.0 tests=FREEMAIL_FROM,FREEMAIL_REPLYTO,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of simon.willnauer@googlemail.com designates 209.85.220.176 as permitted sender) Received: from [209.85.220.176] (HELO mail-vx0-f176.google.com) (209.85.220.176) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Feb 2011 08:20:53 +0000 Received: by vxb37 with SMTP id 37so213596vxb.35 for ; Thu, 03 Feb 2011 00:20:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:mime-version:reply-to:in-reply-to:references :date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=EL/05ITaRA2ayfJmE0XVGxTav/QoLg877hzo46LZG48=; b=fu0HbVouuJwa7zIQaVsi7HArr/sOYrWGqw3lPmyalyhur5OmlAXSo+irfgZCFJvYcE Ij4rR1uNB0+7W5cRPsEVjuJ9jyvID1pNQeIPwCMUE6Cnwtm2EPxJ7NSpTy0JxaDdkW+q UpMZIFCgSvAPXPmlNi3ao6gqZ6Gur871GkUFo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:cc:content-type:content-transfer-encoding; b=ly0XRs7L3TWs0q7DAwFO0BSsWVzasCwTnn0SIXjgSgIDn+fhUJfpWB+1L37vYakR/Z XRlhc9PcX6jcgi2ELa6zK9wDJj9+UoJRY6BvdgU4Lp0kLiFknxAQPJeKS5zNPTdjF+7w ryPV2aowPfA7061Fz2cmZJmnTJM5WbLQd1KyQ= MIME-Version: 1.0 Received: by 10.220.192.205 with SMTP id dr13mr2699226vcb.142.1296721232217; Thu, 03 Feb 2011 00:20:32 -0800 (PST) Received: by 10.220.183.4 with HTTP; Thu, 3 Feb 2011 00:20:32 -0800 (PST) Reply-To: simon.willnauer@gmail.com In-Reply-To: References: Date: Thu, 3 Feb 2011 09:20:32 +0100 Message-ID: Subject: Re: Storing an ID alongside a document From: Simon Willnauer To: java-user@lucene.apache.org Cc: yonik@lucidimagination.com Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Thu, Feb 3, 2011 at 3:23 AM, Jason Rutherglen wrote: > Is it? =C2=A0I thought it would load the values into heap RAM like the > field cache and in addition save the values to disk? =C2=A0Does it also > read the values directly from disk? there is a entire RAM resident part and a Iterator API that reads / streams data directly from disk. look at DocValuesEnum vs, Source simon > > On Wed, Feb 2, 2011 at 2:00 PM, Yonik Seeley = wrote: >> That's exactly what the CSF feature is for, right? =C2=A0(docvalues bran= ch) >> >> -Yonik >> http://lucidimagination.com >> >> >> On Wed, Feb 2, 2011 at 1:03 PM, Jason Rutherglen >> wrote: >> >>> I'm curious if there's a new way (using flex or term states) to store >>> IDs alongside a document and retrieve the IDs of the top N results? >>> The goal would be to minimize HD seeks, and not use field caches >>> (because they consume too much heap space) or the doc stores (which >>> require two seeks). =C2=A0One possible way using the pre-flex system is= to >>> place the IDs into a payload posting that would match all documents, >>> and then [somehow] retrieve the payload only when needed. >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>> For additional commands, e-mail: java-user-help@lucene.apache.org >>> >>> >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org