Return-Path: Delivered-To: apmail-cassandra-dev-archive@www.apache.org Received: (qmail 26854 invoked from network); 8 Jun 2010 21:53:34 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 8 Jun 2010 21:53:34 -0000 Received: (qmail 20929 invoked by uid 500); 8 Jun 2010 21:53:33 -0000 Delivered-To: apmail-cassandra-dev-archive@cassandra.apache.org Received: (qmail 20913 invoked by uid 500); 8 Jun 2010 21:53:33 -0000 Mailing-List: contact dev-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list dev@cassandra.apache.org Received: (qmail 20905 invoked by uid 99); 8 Jun 2010 21:53:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Jun 2010 21:53:33 +0000 X-ASF-Spam-Status: No, hits=3.0 required=10.0 tests=AWL,FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jeremy.hanna1234@gmail.com designates 209.85.211.181 as permitted sender) Received: from [209.85.211.181] (HELO mail-yw0-f181.google.com) (209.85.211.181) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Jun 2010 21:53:27 +0000 Received: by ywh11 with SMTP id 11so4461056ywh.7 for ; Tue, 08 Jun 2010 14:53:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:mime-version :content-type:subject:date:in-reply-to:to:references:message-id :x-mailer; bh=cFPOCbB5HP8i74i0xEk0uypIj5/hbA+8vkD2y/3ewSk=; b=QLKzfOgm7BrbflXnrByYmNnfgNToeTg57ckq/YjbsFVw9JETMXdxXQYieB9VkdKEk5 wjDm23R2E7wu6h6zOWtNnmanI3p/y3rRNcEp/yLLqNRROZt6ruVSHLoNUr4265iKVWh+ Jq7zEMpgV2WDvt4Hpdso8PGZPnfYbEvTWSoHM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:mime-version:content-type:subject:date:in-reply-to:to :references:message-id:x-mailer; b=r9nUN4LFwt3+aASoTH4q4wZXY/MKFIjDqv0UnuASzUYxxIESeGC0Hvm5ZRz8TaFEyS Zccgg0bTQhrNDjbSUkmZ9sP9yF3XYkodMTNyVC7n0P5DjMFBzRptS8aWZcYQksQWRlt4 s57yQ64egnERY5yp/n8u2w9lNMzlkSJ3vlYNw= Received: by 10.151.24.14 with SMTP id b14mr700499ybj.396.1276033986534; Tue, 08 Jun 2010 14:53:06 -0700 (PDT) Received: from m4n97xj.rackspace.corp (fw1-aus1.rackspace.net [64.39.0.68]) by mx.google.com with ESMTPS id v3sm367224ybe.36.2010.06.08.14.53.05 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 08 Jun 2010 14:53:05 -0700 (PDT) From: Jeremy Hanna Mime-Version: 1.0 (Apple Message framework v1078) Content-Type: multipart/alternative; boundary=Apple-Mail-3--773443343 Subject: Re: Hadoop package exposed through thrift Date: Tue, 8 Jun 2010 16:53:03 -0500 In-Reply-To: To: dev@cassandra.apache.org References: <29259B20-48D1-411A-87B7-0BA828D9124A@gmail.com> Message-Id: <894A9B59-AE42-4041-9552-DED01EA6CC39@gmail.com> X-Mailer: Apple Mail (2.1078) --Apple-Mail-3--773443343 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I just didn't know if there were any way to make it easier for the = non-java crowd to take advantage of it. I'll give it some more thought. On Jun 8, 2010, at 4:05 PM, Jonathan Ellis wrote: > exposing it through thrift would mean the path would be >=20 > client > to cassandra [processing thrift command] > to hadoop [giving it a job] > to cassandra [fetching the data] > to hadoop [m/r] > to cassandra [handing result back] > to client >=20 > it just doesn't seem like a good design to me. >=20 > additionally, thrift is meant more for "stuff your app is doing > constantly" while hadoop handles analytics queries. this separation > of duties makes a lot of sense to me. >=20 > On Tue, Jun 8, 2010 at 1:45 PM, Jeremy Hanna = wrote: >> When I gave a presentation on cassandra+hadoop, some ruby folks were = wondering about the possibility of using the MapReduce functionality in = a language other than Java. >>=20 >> I was just wondering if any thought was given to exposing the = org.apache.cassandra.hadoop functionality through thrift. That way the = MapReduce code could be used by several languages and secondarily by = client authors. >>=20 >> I'm just trying to see if there is any reason why it wasn't exposed = through thrift or if more needs to be done before it could be exposed to = languages other than Java. >>=20 >> Thanks, >>=20 >> Jeremy >=20 >=20 >=20 > --=20 > Jonathan Ellis > Project Chair, Apache Cassandra > co-founder of Riptano, the source for professional Cassandra support > http://riptano.com --Apple-Mail-3--773443343--