Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9F20DC4AF for ; Mon, 29 Jul 2013 08:08:40 +0000 (UTC) Received: (qmail 90535 invoked by uid 500); 29 Jul 2013 08:08:38 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 90429 invoked by uid 500); 29 Jul 2013 08:08:37 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 90421 invoked by uid 99); 29 Jul 2013 08:08:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Jul 2013 08:08:37 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a81.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Jul 2013 08:08:31 +0000 Received: from homiemail-a81.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a81.g.dreamhost.com (Postfix) with ESMTP id BD1FBA806E for ; Mon, 29 Jul 2013 01:08:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=from :content-type:message-id:mime-version:subject:date:references:to :in-reply-to; s=thelastpickle.com; bh=PeWzWiiRnzZmx8r0LdwsCgS2jp A=; b=pD3w0IHjfYM0m2DUz/MqblTDst/XazCwVofDBO5IVwRpkFDl1v9c51rdSC IhvoVNc50SrIAvP7ImVEYj+M80FcL5gpxLoRDSHG15K6KC5+Q5L2vpLSx6trazxu bJEjCoAJ0H6ge1ePO8FAqpmcG6DPIJDBPdbh/6g0M+4iDy6YE= Received: from [172.16.1.7] (unknown [203.86.207.101]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a81.g.dreamhost.com (Postfix) with ESMTPSA id 3E35CA8061 for ; Mon, 29 Jul 2013 01:08:09 -0700 (PDT) From: aaron morton Content-Type: multipart/alternative; boundary="Apple-Mail=_34E33FD5-4812-4BA6-88BE-FBC57D6CB78E" Message-Id: Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: hadoop/cassandra integration using CL_ONE... Date: Mon, 29 Jul 2013 20:08:06 +1200 References: To: user@cassandra.apache.org In-Reply-To: X-Mailer: Apple Mail (2.1508) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_34E33FD5-4812-4BA6-88BE-FBC57D6CB78E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 > Is it possible to use CL_ONE with hadoop/cassandra when doing an M/R = job? That's the default.=20 = https://github.com/apache/cassandra/blob/cassandra-1.2/src/java/org/apache= /cassandra/hadoop/ConfigHelper.java#L383 > And more importantly is there a way to configure that such that if my = RF=3D3, that it only reads from 1 of the nodes in that 3. That's how it works AFAIK.=20 > We have 12 nodes and ideally we would for example hope M/R runs on > a2, a9, a5, a12 which happen to cover all token ranges. >=20 > This would leave a1, a3, a4, a6, a7, a8, a10, a11 to be free for the = real-time work. You could try only putting slots on those machines, not sure if that = would work though. The best way to isolate transactional and analytical load is to use = multiple DC's.=20 Cheers ----------------- Aaron Morton Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 27/07/2013, at 3:33 AM, "Hiller, Dean" wrote: > Is it possible to use CL_ONE with hadoop/cassandra when doing an M/R = job? And more importantly is there a way to configure that such that if = my RF=3D3, that it only reads from 1 of the nodes in that 3. >=20 > We have 12 nodes and ideally we would for example hope M/R runs on > a2, a9, a5, a12 which happen to cover all token ranges. >=20 > This would leave a1, a3, a4, a6, a7, a8, a10, a11 to be free for the = real-time work. >=20 > (That was just an example=85obviously, I could pick another 4 nodes = that cover all token ranges). >=20 > Thanks, > Dean --Apple-Mail=_34E33FD5-4812-4BA6-88BE-FBC57D6CB78E Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 Is it possible to use CL_ONE with = hadoop/cassandra when doing an M/R job?That's the = default. 

And more importantly is there a way to configure that such = that if my RF=3D3, that it only reads from 1 of the nodes in that = 3.
That's how it works = AFAIK. 

We have = 12 nodes and ideally we would for example hope M/R runs on
a2, a9, = a5, a12 which happen to cover all token ranges.

This would leave = a1, a3, a4, a6, a7, a8, a10, a11 to be free for the real-time = work.
You could try only putting slots on those machines, = not sure if that would work though.

The best = way to isolate transactional and analytical load is to use multiple = DC's. 

Cheers

http://www.thelastpickle.com

On 27/07/2013, at 3:33 AM, "Hiller, Dean" <Dean.Hiller@nrel.gov> = wrote:

Is it possible to use CL_ONE with hadoop/cassandra when = doing an M/R job? And more importantly is there a way to configure that = such that if my RF=3D3, that it only reads from 1 of the nodes in that = 3.

We have 12 nodes and ideally we would for example hope M/R = runs on
a2, a9, a5, a12 which happen to cover all token = ranges.

This would leave a1, a3, a4, a6, a7, a8, a10, a11 to be = free for the real-time work.

(That was just an example=85obviously,= I could pick another 4 nodes that cover all token = ranges).

Thanks,
Dean

= --Apple-Mail=_34E33FD5-4812-4BA6-88BE-FBC57D6CB78E--