Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D4F1519DFA for ; Tue, 12 Apr 2016 14:37:07 +0000 (UTC) Received: (qmail 64233 invoked by uid 500); 12 Apr 2016 14:37:05 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 64184 invoked by uid 500); 12 Apr 2016 14:37:05 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 64174 invoked by uid 99); 12 Apr 2016 14:37:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Apr 2016 14:37:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 3AB3BC0227 for ; Tue, 12 Apr 2016 14:37:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id MqM0Suwe1FAe for ; Tue, 12 Apr 2016 14:37:04 +0000 (UTC) Received: from mail-oi0-f50.google.com (mail-oi0-f50.google.com [209.85.218.50]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 25C025F1AE for ; Tue, 12 Apr 2016 14:37:03 +0000 (UTC) Received: by mail-oi0-f50.google.com with SMTP id s79so24513495oie.1 for ; Tue, 12 Apr 2016 07:37:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=AbAbFKESnmE6yFH44E6lep74XJvW4D/ozuRuJzKBYdU=; b=F1s4ckDl6xseM+IJk5LUycMIaHhI8WBRyM77n2TN8upJ/cSUkYnwB5XLNDPs85Yrdv IEwjcB0ARhr55Wv9rpMXVISLyDEiQJb1VWkdcMyibuygtl69vkTJ/H+eMmGXRR7/CBOf vZB/jjM/1kIR1LFQt+oZsBN30PheZc+I08iw0wb3rAdFpjwv7JE93jPU2g/g4vya469b D5KOTxE+PyPCM3Ijcp0b/7ORsu1MtkodFXBwqriv8BTXDtL4Y3p19Bv8NAj6k3cxvq2F uT24ifnFaNIQcplWzyVV3ub+PNX59UcHiw/PRPvHfSwvDGgp7Z5qa11Jp29zNkrHdMfx KeNQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=AbAbFKESnmE6yFH44E6lep74XJvW4D/ozuRuJzKBYdU=; b=P1+64Tj45R2y1z8hsheRcWf8uJN0auSXZzE4soQauQY3u0oBDq5cYr2Av8MJz3RODd t/OV/SWSB8dBcwO6ZCHVI8M8SXwvZfTArcF9mX6bKK/rtzdTJqlH/mgcUVAr82fEEBD2 s+bQtiTe7V8dLzsPQsQ6I/yAo0gqINdENiYraHZXzIPCa1xYnM+BBAQME7tO36hG6WbS 4yRCPQULw2TQN8X8uIIosF+4Q1w4207tRf8HiOSYQaKWdPDZg2Iw5eIuU304wWHO8Ob9 MvTOQO7NqjLp3yeo5xv0v5RqyXfmSWVsjeFfVtfSIGN1wCdL8S7uovINw+Tt0WQpAidl z6Lg== X-Gm-Message-State: AOPr4FVnr9Q8MUeIdFoZkOdqbS9nO9AwoZCMiKBWGysYOt/M+8SS6fAbv68Imq9XsM1juFkjKFzpyCvrkzPYSA== X-Received: by 10.202.106.196 with SMTP id f187mr1602282oic.1.1460471822035; Tue, 12 Apr 2016 07:37:02 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Eric Stevens Date: Tue, 12 Apr 2016 14:36:52 +0000 Message-ID: Subject: Re: Traffic inconsistent across nodes To: "user@cassandra.apache.org" Content-Type: multipart/alternative; boundary=001a1141b9562832e305304a9898 --001a1141b9562832e305304a9898 Content-Type: text/plain; charset=UTF-8 Maybe include nodetool status here? Are the four nodes serving reads in one DC (local to your driver's config) while the others are in another? On Tue, Apr 12, 2016, 1:01 AM Anishek Agarwal wrote: > hello, > > we have 8 nodes in one cluster and attached is the traffic patterns across > the nodes. > > its very surprising that only 4 nodes show transmitting (purple) packets. > > our driver configuration on clients has the following load balancing > configuration : > > new TokenAwarePolicy( > new DCAwareRoundRobinPolicy(configuration.get(Constants.LOCAL_DATA_CENTRE_NAME, "WDC")), > true) > > > any idea what is that we are missing which is leading to this skewed data > read patterns > > cassandra drivers as below: > > > com.datastax.cassandra > cassandra-driver-core > 2.1.6 > > > com.datastax.cassandra > cassandra-driver-mapping > 2.1.6 > > > cassandra version is 2.0.17 > > Thanks in advance for the help. > > Anishek > > --001a1141b9562832e305304a9898 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Maybe include nodetool status here?=C2=A0 Are the four nodes= serving reads in one DC (local to your driver's config) while the othe= rs are in another?


On Tue, Apr 12, 2016, 1:01 = AM Anishek Agarwal <anishek@gmail.c= om> wrote:
= hello,=C2=A0

we have 8 nodes in one cluster and attached= is the traffic patterns across the nodes.=C2=A0

i= ts very surprising that only 4 nodes show transmitting (purple) packets.

our driver configuration on clients has the followin= g load balancing configuration =C2=A0:

new TokenAware=
Policy(
        new DCAware=
RoundRobinPolicy(configuration.get(Constants.LOCAL_DATA_CENTRE_NAME, "WDC=
")),
        true)

=
any idea what is that we are missing which is leading to this skewed d= ata read patterns

cassandra drivers as below:=C2= =A0
<dependency>
   =
 <groupId>com.datastax.cassandra</groupId>
=
    <artifactId>cassandra-driver-core</artifactId>
    <version>2.1.6</version>
</d=
ependency>
<dependen=
cy>
    <groupId>=
com.datastax.cassandra</gr=
oupId>
    <artifact=
Id>cassandra-driver-mapping</artifactId>
    &=
lt;version>2.1.6</versi=
on>
</dependency>=

cassandr=
a version is 2.0.17
Thanks in advance for the help.
Anishek
--001a1141b9562832e305304a9898--