Return-Path: Delivered-To: apmail-lucene-solr-user-archive@locus.apache.org Received: (qmail 3430 invoked from network); 5 Nov 2008 10:36:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 5 Nov 2008 10:36:44 -0000 Received: (qmail 68103 invoked by uid 500); 5 Nov 2008 10:36:46 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 68065 invoked by uid 500); 5 Nov 2008 10:36:45 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 68054 invoked by uid 99); 5 Nov 2008 10:36:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Nov 2008 02:36:45 -0800 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of noble.paul@gmail.com designates 64.233.182.191 as permitted sender) Received: from [64.233.182.191] (HELO nf-out-0910.google.com) (64.233.182.191) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Nov 2008 10:35:29 +0000 Received: by nf-out-0910.google.com with SMTP id g16so1582246nfd.15 for ; Wed, 05 Nov 2008 02:36:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=42XLxb3Ww/bqWJQK4M7POyKDiO3+SiJBJwFaOwHleto=; b=IZXRp49Haoiz5aTCQJVboo0czdqGokz2nIB/GtF93exPSwaLjC3BCAVJ3gcHBvCCHJ zwdP7Vcx9JDxL1vc0RlUC9ln45RmkKz+JdKEuq4ZwdK3+e65tfOxYEOxarX+Mygm022y JL5n6qSjj9SReXehgxJlVaFXRnX1oblgtR+RE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=NB4L1uXlodzWBwa+zaacHikLbi1XMsZcNJMOzxRSUHY8/2AhsI5bFhZxHV4s2UaIKY juq2wZoOoIuihCj2kezNLfHcqD9VcKpHSDc4z6AbuMOwYWR9rzKIlaboj7L2WJ/GM2/p +oEWREI8VCPv3gBdOvtV35Ck7BB3gRm+Z5/5c= Received: by 10.210.75.6 with SMTP id x6mr794487eba.56.1225881360927; Wed, 05 Nov 2008 02:36:00 -0800 (PST) Received: by 10.210.60.3 with HTTP; Wed, 5 Nov 2008 02:36:00 -0800 (PST) Message-ID: <5e76b0ad0811050236r32e6bf7fw5660cd4d29e831e0@mail.gmail.com> Date: Wed, 5 Nov 2008 16:06:00 +0530 From: "=?UTF-8?B?Tm9ibGUgUGF1bCDgtKg=?= =?UTF-8?B?4LWL4LSs4LS/4LSz4LWN4oCNIOCkqOCli+CkrOCljeCks+CljQ==?=" To: solr-user@lucene.apache.org Subject: Re: How to handle large field values. In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: X-Virus-Checked: Checked by ClamAV on apache.org the 'fl' parameter can be added to the defaults for your search handler in solrconfig.xml On Wed, Nov 5, 2008 at 3:22 PM, Luca Molteni wrote: > Hello everybody, > > dealing with very large fields, let's say text documents, I found that there > is a global slowness (on my computer) in returning those field. Since most > of the time what we want is an "highlight" value of the field and not the > entire field, I thought that we can omit these field from the query. I've > tried two methods: > > - Stored = false works very well, the query is faster, but the highlightning > doesn't work anymore (sigh, I know it's by design). > - Stored = true and filtering with the "fl" parameters requires me to enter > all the fields by hand, since the fl query doesn't support a minus operator > (let's say, all the field withouth my > veryLargeFieldIDontWantToRetrieveButIWantToSeeAVerySmallPortion). > > Strangely, using the "fl" parameter in federeated search with "shards" and > two different server with different schemas, gave me strange results (no > results, actually). It all works well using only one shard, but it was very > difficult to benchmark it. > > Any advice? I hope I'm missing something. > > Thanks, > > L.M. > -- --Noble Paul