lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akiel Ahmed <AHMED...@uk.ibm.com>
Subject Re: Exporting Score value from export handler
Date Tue, 09 Feb 2016 09:32:50 GMT
Hi Joel,

I saw your response this morning, and have created an issue, SOLR-8664, 
and linked it to SOLR-8125. As context, I included my original question 
and your answer, as a comment.

Cheers

Akiel



From:   Joel Bernstein <joelsolr@gmail.com>
To:     solr-user@lucene.apache.org
Date:   29/01/2016 13:46
Subject:        Re: Exporting Score value from export handler



Exporting scores would be a great feature to have. I don't believe it will
add too much complexity to export and sort by score. The main 
consideration
has been memory consumption for every large export sets. The export 
feature
powers SQL queries that are unlimited in Solr 6. So adding scores to 
export
would support queries like:

select id, title, score from tableX where a = '(a query)'

Where currently you can only do this:

select id, title, score from tableX where a = '(a query)' limit 1000

Can you create a jira for this and link it to SOLR-8125.




Joel Bernstein
http://joelsolr.blogspot.com/

On Fri, Jan 29, 2016 at 8:26 AM, Akiel Ahmed <AHMEDAKI@uk.ibm.com> wrote:

> Hi,
>
> I would like to issue a query and get the ID and Score for each matching
> document. There may be lots of results so I wanted to use the export
> handler, but unfortunately the current version of Solr doesn't seem to
> export the Score - I read the comments on
> https://issues.apache.org/jira/browse/SOLR-5244 (Exporting Full Sorted
> Result Sets) but am not sure what happened with the idea of exporting 
the
> Score. Does anybody know of an existing or future version where this can
> be done?
>
> I compared exporting 100,000 IDs via the export handler with getting
> 100,000 ID,Score pairs using the cursor mark - exporting 100,000 IDs was
> an order of magnitude faster on my laptop. Does anybody know of a faster
> way to retrieve the ID,Score pairs for a query on a SolrScloud 
deployment
> and/or have an idea on the possible performance characteristics of
> exporting ID, Score (without ranking) if it was to be implemented?
>
> Cheers
>
> Akiel
> Unless stated otherwise above:
> IBM United Kingdom Limited - Registered in England and Wales with number
> 741598.
> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 
3AU
>


Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message