Return-Path: 
 <solr-dev-return-23379-apmail-lucene-solr-dev-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-solr-dev-archive@minotaur.apache.org
Received: (qmail 27084 invoked from network); 30 Dec 2009 10:41:55 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3)
  by minotaur.apache.org with SMTP; 30 Dec 2009 10:41:55 -0000
Received: (qmail 46995 invoked by uid 500); 30 Dec 2009 10:41:54 -0000
Delivered-To: apmail-lucene-solr-dev-archive@lucene.apache.org
Received: (qmail 46923 invoked by uid 500); 30 Dec 2009 10:41:53 -0000
Mailing-List: contact solr-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:solr-dev-help@lucene.apache.org>
List-Unsubscribe: <mailto:solr-dev-unsubscribe@lucene.apache.org>
List-Post: <mailto:solr-dev@lucene.apache.org>
List-Id: <solr-dev.lucene.apache.org>
Reply-To: solr-dev@lucene.apache.org
Delivered-To: mailing list solr-dev@lucene.apache.org
Received: (qmail 46621 invoked by uid 99); 30 Dec 2009 10:41:53 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Dec 2009 10:41:53 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=10.0
	tests=ALL_TRUSTED
X-Spam-Check-By: apache.org
Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Dec 2009 10:41:51 +0000
Received: from brutus.apache.org (localhost [127.0.0.1])
	by brutus.apache.org (Postfix) with ESMTP id 88C4A234C498
	for <solr-dev@lucene.apache.org>; Wed, 30 Dec 2009 02:41:30 -0800 (PST)
Message-ID: <1433636106.1262169690559.JavaMail.jira@brutus.apache.org>
Date: Wed, 30 Dec 2009 10:41:30 +0000 (UTC)
From: "Shalin Shekhar Mangar (JIRA)" <jira@apache.org>
To: solr-dev@lucene.apache.org
Subject: [jira] Updated: (SOLR-1682) Implement CollapseComponent
In-Reply-To: <1947458636.1261428318168.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org


     [ https://issues.apache.org/jira/browse/SOLR-1682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shalin Shekhar Mangar updated SOLR-1682:
----------------------------------------

    Attachment: SOLR-236.patch

Here's an implementation based on [Yonik's suggestion|https://issues.apache.org/jira/browse/SOLR-236?focusedCommentId=12792916&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12792916].

This is just a PoC and not fit to be committed. This implementation uses one pass for collapse.threshold=1 and two passes for collapse.threshold>1 so it should be a lot faster than the previous method. Though, I haven't benchmarked yet. Memory consumption should be proportional to start+count instead of index size.

What is covered:
# Non-adjacent collapsing
# collapse.threshold
# [New response format|https://issues.apache.org/jira/browse/SOLR-236?focusedCommentId=12793101&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12793101]
# Includes DocSetAwareCollector interface from SOLR-1680

What is not covered:
# Adjacent collapsing
# Aggregate functions (should be easy to add)
# Faceting (it doesn't keep/return the docsets needed for FacetComponent)
# Caching
# This implementation does not return the correct numFound

The response adds special fields to only the first document in a group. Here's a sample of the first document in a group:
{code:xml}
<doc>
      <int name="id">1</int>
      <str name="name_s1">author1</str>
      <str name="title_s1">a tree</str>
      <date name="timestamp">2009-12-30T10:16:51.944Z</date>
      <arr name="multiDefault">
        <str>muLti-Default</str>
      </arr>
      <int name="intDefault">42</int>
      <str name="collapse.value">author1</str>
      <int name="collapse.count">1</int>
      <float name="score">0.67107505</float>
    </doc>
{code}

See TestCollapseComponent.java for example usage.

> Implement CollapseComponent
> ---------------------------
>
>                 Key: SOLR-1682
>                 URL: https://issues.apache.org/jira/browse/SOLR-1682
>             Project: Solr
>          Issue Type: Sub-task
>          Components: search
>            Reporter: Martijn van Groningen
>            Assignee: Shalin Shekhar Mangar
>             Fix For: 1.5
>
>         Attachments: field-collapsing.patch, SOLR-236.patch
>
>
> Child issue of SOLR-236. This issue is dedicated to field collapsing in general and all its code (CollapseComponent, DocumentCollapsers and CollapseCollectors). The main goal is the finalize the request parameters and response format.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.