Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 24232 invoked from network); 29 Nov 2010 20:33:19 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 29 Nov 2010 20:33:19 -0000 Received: (qmail 30109 invoked by uid 500); 29 Nov 2010 20:33:17 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 30090 invoked by uid 500); 29 Nov 2010 20:33:17 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 30082 invoked by uid 99); 29 Nov 2010 20:33:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Nov 2010 20:33:17 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a57.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Nov 2010 20:33:12 +0000 Received: from homiemail-a57.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a57.g.dreamhost.com (Postfix) with ESMTP id 8C07820806D for ; Mon, 29 Nov 2010 12:32:50 -0800 (PST) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=to:from :subject:date:message-id:content-type:mime-version:in-reply-to; q=dns; s=thelastpickle.com; b=EDc1iED6yvEtc08H+EFaP49zZSOm+X8qN RvCOvWj8VOzh/LKU8yE7q+32Se7ntRZIYNA6y9Wp8Hi4fuV9FUNnuWRzTpPmRVzF pOVL4roB2qlPrCKlSyrTtWLftQdaVkmI378OvUtqRhJqC332n/yMJjxBRcCyOkv9 JR5p1CJOYU= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=to :from:subject:date:message-id:content-type:mime-version: in-reply-to; s=thelastpickle.com; bh=FPmFBXU37uHxJJJj4j5rkzVfQT4 =; b=b950HASmuxW4KC96KDkftIftZxuREYQdX0x8gkgnecgE4ze4I+Au12wUHoq E/47RCefmpj8SfvyAjOwK9Ph1cLXuSwZQWrywnHXSVRow81b1lZrvJuj/yhnKAu7 ZVMpZzwGQs1ZrJmAOzq3iQ473kgxDGStH8tk8EJO8alyGDG0= Received: from localhost (webms.mac.com [17.148.16.116]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a57.g.dreamhost.com (Postfix) with ESMTPSA id 793E3208087 for ; Mon, 29 Nov 2010 12:32:50 -0800 (PST) To: user@cassandra.apache.org From: Aaron Morton Subject: Re: Solr DataImportHandler (DIH) and Cassandra Date: Mon, 29 Nov 2010 20:32:49 GMT X-Mailer: MobileMe Mail (1C3207) Message-id: <42c0242b-6e08-e2c7-fc28-8c6f3e6869dc@me.com> Content-Type: multipart/alternative; boundary=Apple-Webmail-42--0a369733-c081-c739-a734-ee26ace01eb2 MIME-Version: 1.0 In-Reply-To: <4CF3CEF5.2070903@gmail.com> --Apple-Webmail-42--0a369733-c081-c739-a734-ee26ace01eb2 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=ISO-8859-1; format=flowed AFAIK there is nothing pre-written to pull the data out for you.=A0=0A=0AY= ou should be able to create your DataSource sub class=A0http://lucene.apac= he.org/solr/api/org/apache/solr/handler/dataimport/DataSource.html=A0Using= the Hector java library to pull data from Cassandra.=A0=0A=0AI'm guessing= you=A0will need to consider how to perform delta imports. Perhaps using t= he secondary indexes in 0.7* , or maintaining your own queues or indexes t= o know what has changed.=A0=0A=0AThere is also the Lucandra project, not e= xactly what your after but may be of interest anyway=A0https://github.com/= tjake/Lucandra=0A=0AHope that helps.=0AAaron=0A=0A=0AOn 30 Nov, 2010,at 05= :04 AM, Mark wrote:=0A=0AIs there anyway to us= e DIH to import from Cassandra? Thanks=0A --Apple-Webmail-42--0a369733-c081-c739-a734-ee26ace01eb2 Content-Type: multipart/related; type="text/html"; boundary=Apple-Webmail-86--0a369733-c081-c739-a734-ee26ace01eb2 --Apple-Webmail-86--0a369733-c081-c739-a734-ee26ace01eb2 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=ISO-8859-1;
AFAIK there is nothing pre-written to pull the data out for you. = ;

You should be able to create your DataSource su= b class http://lucene.apache.org/solr/api/org/= apache/solr/handler/dataimport/DataSource.html Using the Hector j= ava library to pull data from Cassandra. 

I'm guessing you will need to consider how to perform delta imp= orts. Perhaps using the secondary indexes in 0.7* , or maintaining your ow= n queues or indexes to know what has changed. 

There is = also the Lucandra project, not exactly what your after but may be of inter= est anyway https://githu= b.com/tjake/Lucandra

Hope that helps.
Aaron

<= br>On 30 Nov, 2010,at 05:04 AM, Mark <static.void.dev@gmail.com> wro= te:

Is there anyway to use DIH to import from Cassandra? Thanks
=0A
--Apple-Webmail-86--0a369733-c081-c739-a734-ee26ace01eb2-- --Apple-Webmail-42--0a369733-c081-c739-a734-ee26ace01eb2--