lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Upayavira ...@odoko.co.uk>
Subject Re: Custom Solr caches in a FunctionQuery that emulates the ExternalFileField
Date Fri, 24 Jul 2015 12:41:27 GMT
Mikhail,

I've tried this out, but to be honest I can't work out what the score=
parameter is supposed to add.

I assume that if I do {!join fromIndex=other from=other_key to=key
score=max}somefield:(abc dev)

It will calculate the score for each document that has the same "key"
value, and include that in the score for the main document?

If this is the case, then I should be able to do:

{!join fromIndex=other from=other_key to=key score=max}{!boost
b=my_boost_value_field}*:*

In which case, it'll take the value of "my_boost_field" in the other
core, and include it in the score for my document that has the value of
"key"?

Upayavira

On Fri, Jul 10, 2015, at 04:15 PM, Mikhail Khludnev wrote:
> I've heard that people use
> https://issues.apache.org/jira/browse/SOLR-6234
> for such purpose - adding scores from fast moving core to the bigger slow
> moving one
> 
> On Fri, Jul 10, 2015 at 4:54 PM, Upayavira <uv@odoko.co.uk> wrote:
> 
> > All,
> >
> > I have knocked up what I think could be a really cool function query -
> > it allows you to retrieve a value from another core (much like a pseudo
> > join) and use that value during scoring (much like an
> > ExternalFileField).
> >
> > Examples:
> >  * Selective boosting of documents based upon a category based value
> >  * boost on aggregated popularity values
> >  * boost on fast moving data on your slow moving index
> >
> > It *works* but it does so very slowly (on 3m docs, milliseconds without,
> > and 24s with it). There are two things that happen a lot:
> >
> >  * locate a document with unique ID value of X
> >  * retrieve the value of field Y for that doc
> >
> > What it seems to me now is that I need to implement a cache that will
> > have a string value as the key and the (float) field value as the
> > object, that is warmed alongside existing caches.
> >
> > Any pointers to examples of how I could do this, or other ways to do the
> > conversion from a key value to a float value faster?
> >
> > NB. I hope to contribute this if I can make it perform.
> >
> > Thanks!
> >
> > Upayavira
> >
> 
> 
> 
> -- 
> Sincerely yours
> Mikhail Khludnev
> Principal Engineer,
> Grid Dynamics
> 
> <http://www.griddynamics.com>
> <mkhludnev@griddynamics.com>

Mime
View raw message