Return-Path: 
 <solr-dev-return-21556-apmail-lucene-solr-dev-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-solr-dev-archive@minotaur.apache.org
Received: (qmail 9295 invoked from network); 10 Nov 2009 13:55:26 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3)
  by minotaur.apache.org with SMTP; 10 Nov 2009 13:55:26 -0000
Received: (qmail 17769 invoked by uid 500); 10 Nov 2009 13:55:26 -0000
Delivered-To: apmail-lucene-solr-dev-archive@lucene.apache.org
Received: (qmail 17666 invoked by uid 500); 10 Nov 2009 13:55:25 -0000
Mailing-List: contact solr-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:solr-dev-help@lucene.apache.org>
List-Unsubscribe: <mailto:solr-dev-unsubscribe@lucene.apache.org>
List-Post: <mailto:solr-dev@lucene.apache.org>
List-Id: <solr-dev.lucene.apache.org>
Reply-To: solr-dev@lucene.apache.org
Delivered-To: mailing list solr-dev@lucene.apache.org
Received: (qmail 17656 invoked by uid 99); 10 Nov 2009 13:55:25 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Nov 2009 13:55:25 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=10.0
	tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [81.201.117.186] (HELO exchange.btelligent.net)
 (81.201.117.186)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Nov 2009 13:55:14 +0000
Received: from [192.168.2.233] (212.202.134.166) by owa.btelligent.net
 (81.201.117.186) with Microsoft SMTP Server (TLS) id 8.1.291.1; Tue, 10 Nov
 2009 14:54:53 +0100
Message-ID: <4AF970AD.2030305@btelligent.de>
Date: Tue, 10 Nov 2009 14:54:53 +0100
From: Chantal Ackermann <chantal.ackermann@btelligent.de>
Organization: b.telligent GmbH
User-Agent: Thunderbird 2.0.0.23 (Windows/20090812)
MIME-Version: 1.0
To: "solr-dev@lucene.apache.org" <solr-dev@lucene.apache.org>,
	"yonik@lucidimagination.com" <yonik@lucidimagination.com>
Subject: Re: MoreLikeThis > interestingTerms : SortableIntField breaks XML
References: <4AF96440.60304@btelligent.de>
 <c68e39170911100519v7fa418a1i9391c7f018dbe787@mail.gmail.com>
In-Reply-To: <c68e39170911100519v7fa418a1i9391c7f018dbe787@mail.gmail.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 8bit
X-Virus-Checked: Checked by ClamAV on apache.org

Hi Yonik,

I'll do that. Is this a general requirement: that the terms have to be 
externalized? Because the TermVectorComponent doesn't externalize 
either. Shall the ticket mention that?

Thanks,
Chantal


Response using TermVectorComponent:

<lst name="termVectors">
−
<lst name="doc-0">
<str name="uniqueKey">#8;#0;#0;ϐ㭍</str>
<lst name="cat">
−
<lst name="€#0;Ȁ">
<int name="tf">1</int>
<int name="df">93962</int>
</lst>
−
<lst name="€#0;ࠂ">
<int name="tf">1</int>
<int name="df">1165</int>
</lst>
</lst>
...

Yonik Seeley schrieb:
> On Tue, Nov 10, 2009 at 8:01 AM, Chantal Ackermann
> <chantal.ackermann@btelligent.de> wrote:
>> I've just realised that this line in the result for an MLT query is broken:
>>
>> <float name="decade:€#0;ߐ">0.2517573</float>
>> (this is the last child of element "interestingTerms" see more output below)
> 
> Looks like MLT doesn't "externalize" terms... can you open a JIRA issue?
> 
> -Yonik
> http://www.lucidimagination.com
> 
> 
>> decade should contain the int "2000" from what I can see in the results for
>> that query. The representation of "2000" as SortableInt seems to contain
>> characters that break the XML output?
>>
>> Cheers,
>> Chantal
>>
>>
>> .../solr/mlt?mlt.mindf=50&sort=score+desc,start_date+asc,sid+asc
>> &fl=id,year,decade,title,start_date,score,sid
>> &mlt.fl=cat,participant,decade,country&start=0
>> &q=id:32883780&mlt.mintf=1&mlt.match.include=true&rows=50
>> &version=1&mlt.interestingTerms=details&mlt.boost=true
>>
>>
>> ...
>> <doc>
>> <float name="score">3.9147425</float>
>> <int name="decade">2000</int>
>> <long name="id">32725355</long>
>> <long name="sid">1518610</long>
>> <date name="start_date">2009-11-14T06:00:00Z</date>
>> <str name="title">Smoking</str>
>> <int name="year">2002</int>
>> </doc>
>> ...
>> <lst name="interestingTerms">
>> <float name="participant:Nichelle Nichols">1.0</float>
>> <float name="participant:James Coburn">0.9949831</float>
>> <float name="participant:John Debney">0.93337345</float>
>> <float name="cat:€#0;Ă">0.5553121</float>
>> <float name="country:CDN">0.5469994</float>
>> <float name="cat:€#0;Ā">0.38832104</float>
>> <float name="country:USA">0.31487963</float>
>> <float name="decade:€#0;ߐ">0.2517573</float>
>> </lst>
>>