Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of simon.willnauer@googlemail.com
 designates 209.85.210.182 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=googlemail.com; s=gamma;
        h=mime-version:reply-to:in-reply-to:references:date:message-id
         :subject:from:to:content-type:content-transfer-encoding;
        b=DlGVK522J+YgN3cerxciHeJKuN9+j930JL9VfunLZGvOxv1o2Da6rO3ZwuQP1Tgu1g
         8WjxsWwhbBsQTPJ2ZBKTvj0Ldk8zS5FHWMz1CtHvAqYbp/F/IpVpizUqhNHrKA0BLs0f
         3O9afeNXoTOJMsARAhM6XSC7Xk+oVaVYnOMv0=
MIME-Version: 1.0
Reply-To: simon.willnauer@gmail.com
In-Reply-To: <24257547.post@talk.nabble.com>
References: <24251993.post@talk.nabble.com> <24253338.post@talk.nabble.com>
	 <f18c9dde0906290544la83384kf7d00158c08c053e@mail.gmail.com>
	 <24253583.post@talk.nabble.com>
	 <f18c9dde0906290558k2f8ecb0dnfc8b71c1bb6898bc@mail.gmail.com>
	 <24253760.post@talk.nabble.com>
	 <f18c9dde0906290616r7fc957bfm1f657cd8fa8cc7b0@mail.gmail.com>
	 <24254191.post@talk.nabble.com>
	 <f18c9dde0906290653h23686aa4g536e507acf5ef674@mail.gmail.com>
	 <24257547.post@talk.nabble.com>
Date: Mon, 29 Jun 2009 18:46:46 +0200
Message-ID: <f18c9dde0906290946u52359f16o9c9e9913961bf693@mail.gmail.com>
Subject: Re: Read large size index
From: Simon Willnauer <simon.willnauer@googlemail.com>
To: java-user@lucene.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

On Mon, Jun 29, 2009 at 6:36 PM, m.harig<m.harig@gmail.com> wrote:
>
> Thanks Simon ,
>
> Hey there, that makes things easier. :)
>
> ok here are some questions:
>
>>>>Do you iterate over all docs calling hits.doc(i) ?If so do you have to
> load all fields to render your results, if not you should not retrieve
> all of them?
>
>
> Yes, am iterating over all docs by calling hits.doc(i) ,
do you really need to get all docs? wouldn't it be enough to fetch
just the top N you want to display or do you want to display all of
them?
>
>
>
> You use IndexSearchersearch(Query q,...) which returns a Hits object
> have you tried to use the new search methods returning TopDocs?
>
> Sorry, i didn't , could you please send me a piece of code.
Example:
  IndexReader open = IndexReader.open("/tmp/testindex/");
    IndexSearcher searcher = new IndexSearcher(open);
    final String fName = "test";
    TopDocs topDocs = searcher.search(new TermQuery(new Term(fName, "lucene")),
        Integer.MAX_VALUE);
    FieldSelector selector = new FieldSelector() {
      public FieldSelectorResult accept(String fieldName) {
        return fieldName == fName ? FieldSelectorResult.LOAD
            : FieldSelectorResult.NO_LOAD;
      }

    };

    final int totalHits = topDocs.totalHits;
    ScoreDoc[] scoreDocs = topDocs.scoreDocs;
    for (int i = 0; i < totalHits; i++) {
      Document doc = searcher.doc(scoreDocs[i].doc, selector);
    }
>
> when you search for pdf and get 30k results you load all the "stored"
> field content into memory once you call IndexSearcher.doc(i) as it
> internally calls IndexReader.document(i, null). This is equivalent to
> a "Load All fields" FieldSelector.
> You can have a closer look at FieldSelector and the new search methods
> which accept them. This is a way to make you retrieval faster and load
> only the fields you really need.
>
>
>
> --
> View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24257547.html
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org