Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 65022 invoked from network); 1 Dec 2010 22:55:23 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 1 Dec 2010 22:55:23 -0000 Received: (qmail 51210 invoked by uid 500); 1 Dec 2010 22:55:20 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 51183 invoked by uid 500); 1 Dec 2010 22:55:20 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 51175 invoked by uid 99); 1 Dec 2010 22:55:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Dec 2010 22:55:20 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a78.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Dec 2010 22:55:13 +0000 Received: from homiemail-a78.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a78.g.dreamhost.com (Postfix) with ESMTP id AD77F15C069 for ; Wed, 1 Dec 2010 14:54:46 -0800 (PST) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=to:from :subject:date:message-id:content-type:mime-version:in-reply-to; q=dns; s=thelastpickle.com; b=f50uBZ73c9jtiG2wMg2S5YOtSpygEA7eZ se6P9zem395xP6guIVe4Y34x0i0YDKfxJDfwoSJ64MoFF3yvRSS7UzPghUREC0jV v/jVp/bIJn+x9GJz+cuhjbjqUTNjvcY2ytcmnZueYyNZhhTEYi+tGwTiKyZ6p4GB vRCDJKzj1g= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=to :from:subject:date:message-id:content-type:mime-version: in-reply-to; s=thelastpickle.com; bh=V3yiusuhZqTx35MItHITfHKeTgA =; b=V+CeQrLesdBEn4dFSBkdiUVRVsPSBIwCyBKPby7XGkxX780ITUaMXnNF4gY pqrqZmRp8ZsBMCUbRPxrkuGTnGp7n1dpd91LFaV78LH4dI/I7MASyjemnowfB6fl Ewi0O3EIinuqFjNJJ8ZldpJgYMmZk+EzwEZuT046cBRqklFY= Received: from localhost (webms.mac.com [17.148.16.116]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a78.g.dreamhost.com (Postfix) with ESMTPSA id 9715315C071 for ; Wed, 1 Dec 2010 14:54:46 -0800 (PST) To: user@cassandra.apache.org From: Aaron Morton Subject: Re: Solr DataImportHandler (DIH) and Cassandra Date: Wed, 01 Dec 2010 22:54:45 GMT X-Mailer: MobileMe Mail (1C3207) Message-id: <1f578ef8-c537-cdb9-ba16-e0f00f3c7724@me.com> Content-Type: multipart/alternative; boundary=Apple-Webmail-42--e268a690-76cd-4e09-ccf4-f36b553e7389 MIME-Version: 1.0 In-Reply-To: <4CF4475B.7050308@gmail.com> X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Webmail-42--e268a690-76cd-4e09-ccf4-f36b553e7389 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=ISO-8859-1; format=flowed Try the solr source code.=A0=0AAaron=0A=0AOn 30 Nov, 2010,at 01:37 PM, Mar= k wrote:=0A=0AThe DataSource subclass route is= what I will probably be interested in. Are there are working examples of = this already out there? =0A=0AOn 11/29/10 12:32 PM, Aaron Morton wrote:=0A= AFAIK there is nothing pre-written to pull the data out for you.=A0=0A=0AY= ou should be able to create your DataSource sub class=A0http://lucene.apac= he.org/solr/api/org/apache/solr/handler/dataimport/DataSource.html=A0Using= the Hector java library to pull data from Cassandra.=A0=0A=0A=0AI'm guess= ing you=A0will need to consider how to perform delta imports. Perhaps usin= g the secondary indexes in 0.7* , or maintaining your own queues or indexe= s to know what has changed.=A0=0A=0AThere is also the Lucandra project, no= t exactly what your after but may be of interest anyway=A0 https://github.= com/tjake/Lucandra=0A=0AHope that helps.=0AAaron=0A=0A=0AOn 30 Nov, 2010,a= t 05:04 AM, Mark wrote:=0A=0AIs there anyway t= o use DIH to import from Cassandra? Thanks=0A --Apple-Webmail-42--e268a690-76cd-4e09-ccf4-f36b553e7389 Content-Type: multipart/related; type="text/html"; boundary=Apple-Webmail-86--e268a690-76cd-4e09-ccf4-f36b553e7389 --Apple-Webmail-86--e268a690-76cd-4e09-ccf4-f36b553e7389 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=ISO-8859-1;
Try the solr source code. 
Aaron

On 30 N= ov, 2010,at 01:37 PM, Mark <static.void.dev@gmail.com> wrote:
=0A The DataSource subclass route is what I will probably be inte= rested=0A in. Are there are working examples of this already out there?= =0A=0A =0A =0A =0A
=0A
=0A On 11/29/10 12:32 PM, Aaro= n Morton wrote:=0A
=0A
AF= AIK there is nothing pre-written to pull the data out for=0A you.&n= bsp;
=0A

=0A
=0A
You should be abl= e to create your DataSource sub class http://lucene.apache.org/solr/api/org/apache/solr/handler= /dataimport/DataSource.html Using=0A the Hector java libra= ry to pull data from Cassandra. 
=0A

=0A =

=0A
=0A
I'm guessing you will need to= consider how to perform delta=0A imports. Perhaps using the second= ary indexes in 0.7* , or=0A maintaining your own queues or indexes = to know what has=0A changed. 
=0A

=0A =
=0A
There is also the Lucandra project, not exactly what y= our=0A after but may be of interest anyway =0A =0A = https://github.com/tjake/Lucandra
=0A =

=0A
=0A
Hope that helps.
=0A Aaron
=0A

=0A
=0A On 30 Nov, 2010,at= 05:04 AM, Mark=0A <static.void.dev@gmail.com> wrote:
=0A
=0A =
=0A
=0A
=0A =0A
Is there anyway to use DIH to impo= rt=0A from Cassandra? Thanks
=0A
=0A =
=0A
=0A
=0A =0A = =0A=0A --Apple-Webmail-86--e268a690-76cd-4e09-ccf4-f36b553e7389-- --Apple-Webmail-42--e268a690-76cd-4e09-ccf4-f36b553e7389--