Return-Path: 
 <user-return-19294-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org>
X-Original-To: apmail-cassandra-user-archive@www.apache.org
Delivered-To: apmail-cassandra-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 45606617A
	for <apmail-cassandra-user-archive@www.apache.org>;
 Sat, 30 Jul 2011 01:05:19 +0000 (UTC)
Received: (qmail 1090 invoked by uid 500); 30 Jul 2011 01:05:16 -0000
Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org
Received: (qmail 771 invoked by uid 500); 30 Jul 2011 01:05:15 -0000
Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@cassandra.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@cassandra.apache.org>
List-Post: <mailto:user@cassandra.apache.org>
List-Id: <user.cassandra.apache.org>
Reply-To: user@cassandra.apache.org
Delivered-To: mailing list user@cassandra.apache.org
Received: (qmail 755 invoked by uid 99); 30 Jul 2011 01:05:14 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 30 Jul 2011 01:05:14 +0000
X-ASF-Spam-Status: No, hits=-0.6 required=5.0
	tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of jeremy.hanna1234@gmail.com
 designates 209.85.213.172 as permitted sender)
Received: from [209.85.213.172] (HELO mail-yx0-f172.google.com)
 (209.85.213.172)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 30 Jul 2011 01:05:07 +0000
Received: by yxp4 with SMTP id 4so3222209yxp.31
        for <multiple recipients>; Fri, 29 Jul 2011 18:04:46 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=subject:mime-version:content-type:from:in-reply-to:date:cc
         :content-transfer-encoding:message-id:references:to:x-mailer;
        bh=XG5rjQ9bqXLXVk5pHuxSCvedtVIBOp1RdarIwnNUBbs=;
        b=HN5YCPrD3xkZK5m7LHYWVxYI6SJSG1uWJTKUo/Umvjbh5u1CAOR7l8tfFB8uiazuDj
         J/Q07MdLl9qzQMn5oxeGxqa/G715KeClsh9wnU+zi5KeyXYWlClMHS6m00bbyJmO/mAb
         Or5ZxluTcZBLP51RAlSOlHIP5CElwcVcOmBjM=
Received: by 10.236.177.1 with SMTP id c1mr1063795yhm.212.1311987885196;
        Fri, 29 Jul 2011 18:04:45 -0700 (PDT)
Received: from [192.168.1.77] (108-90-0-32.lightspeed.austtx.sbcglobal.net
 [108.90.0.32])
        by mx.google.com with ESMTPS id o47sm1715218yhn.58.2011.07.29.18.04.43
        (version=TLSv1/SSLv3 cipher=OTHER);
        Fri, 29 Jul 2011 18:04:44 -0700 (PDT)
Subject: Re: Cassandra Pig with network topology and data centers.
Mime-Version: 1.0 (Apple Message framework v1244.3)
Content-Type: text/plain; charset=us-ascii
From: Jeremy Hanna <jeremy.hanna1234@gmail.com>
In-Reply-To: 
 <CANpsMSG3Bku+jXYQngOfih6+=f0R7hL2Q7h3Y+yLknx8EN-v4w@mail.gmail.com>
Date: Fri, 29 Jul 2011 20:04:42 -0500
Cc: dev@cassandra.apache.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <E7528E5E-574B-4187-8B3A-EC2933D94B0E@gmail.com>
References: <loom.20110730T002226-75@post.gmane.org>
 <E2FA9ADE-7FFB-46D9-9585-32D60A9AF790@gmail.com>
 <CANpsMSG3Bku+jXYQngOfih6+=f0R7hL2Q7h3Y+yLknx8EN-v4w@mail.gmail.com>
To: user@cassandra.apache.org
X-Mailer: Apple Mail (2.1244.3)

fwiw - https://issues.apache.org/jira/browse/CASSANDRA-2970

thoughts? (please post on the ticket)

On Jul 29, 2011, at 7:08 PM, Ryan King wrote:

> It'd be great if we had different settings for inter- and intra-DC =
read repair.
>=20
> -ryan
>=20
> On Fri, Jul 29, 2011 at 5:06 PM, Jake Luciani <jakers@gmail.com> =
wrote:
>> Yes it's read repair you can lower the read repair chance to tune =
this.
>>=20
>>=20
>>=20
>> On Jul 29, 2011, at 6:31 PM, Aaron Griffith =
<aaron.c.griffith@gmail.com> wrote:
>>=20
>>> I currently have a 9 node cassandra cluster setup as follows:
>>>=20
>>> DC1: Six nodes
>>> DC2: Three nodes
>>>=20
>>> The tokens alternate between the two datacenters.
>>>=20
>>> I have hadoop installed as tasktracker/datanodes on the
>>> three cassandra nodes in DC2.
>>>=20
>>> There is another non cassandra node that is used as the hadoop =
namenode / job
>>> tracker.
>>>=20
>>> When running pig scripts pointed to a node in DC2 using LOCAL_QUORUM =
as read
>>> consistency I am seeing network and cpu spikes on the nodes in DC1.  =
I was
>>> not expecting any impact on those nodes when local quorum is used.
>>>=20
>>> Can read repair be causing the traffic/cpu spikes?
>>>=20
>>> The replication settings for DC1 is 5, and for DC2 is 1.
>>>=20
>>> When looking at the map tasks I am seeing input splits for computers =
in
>>> both data centers.  I am not sure what this means.  My thought is
>>> that is should only be getting data from the nodes in DC2.
>>>=20
>>> Thanks
>>>=20
>>> Aaron
>>>=20
>>=20