lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley (JIRA)" <j...@apache.org>
Subject [jira] Updated: (SOLR-2205) Grouping performance improvements
Date Fri, 29 Oct 2010 03:49:19 GMT

     [ https://issues.apache.org/jira/browse/SOLR-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yonik Seeley updated SOLR-2205:
-------------------------------

    Attachment: SOLR-2205.patch

I've committed the first part of this patch that compares with the smallest group first (before
finding the group of the current doc).  I also committed the addition of the ord methods to
DocValues (we need something like that anyway).

Here's an additional patch that removes the second (redundant) comparison with the lowest
group (in addition to some other minor tweaks like removing the boolean).

> Grouping performance improvements
> ---------------------------------
>
>                 Key: SOLR-2205
>                 URL: https://issues.apache.org/jira/browse/SOLR-2205
>             Project: Solr
>          Issue Type: Sub-task
>          Components: search
>    Affects Versions: 4.0
>            Reporter: Martijn van Groningen
>             Fix For: 4.0
>
>         Attachments: SOLR-2205.patch, SOLR-2205.patch
>
>
> This issue is dedicated to the performance of the grouping functionality.
> I've noticed that the code is not really performing on large indexes. Doing a search
(q=*:*) with grouping on an index from around 5M documents took around one second on my local
development machine. We had to support grouping on an index that holds around 50M documents
per machine, so we made some changes and were able to happily serve that amount of documents.
Patch will follow soon.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message