Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6D8B218688 for ; Wed, 10 Feb 2016 20:30:11 +0000 (UTC) Received: (qmail 71023 invoked by uid 500); 10 Feb 2016 20:30:07 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 70986 invoked by uid 500); 10 Feb 2016 20:30:07 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 70976 invoked by uid 99); 10 Feb 2016 20:30:07 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Feb 2016 20:30:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id CCF6EC0044 for ; Wed, 10 Feb 2016 20:30:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id HWlphjP26GYL for ; Wed, 10 Feb 2016 20:30:04 +0000 (UTC) Received: from mail-yw0-f175.google.com (mail-yw0-f175.google.com [209.85.161.175]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 85E8531ADE for ; Wed, 10 Feb 2016 20:30:03 +0000 (UTC) Received: by mail-yw0-f175.google.com with SMTP id g127so23792565ywf.2 for ; Wed, 10 Feb 2016 12:30:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=uiIQrqoAtqLh48nNW7BxBTk9I50dmV9fOfGOr8kEqAg=; b=eFZGqO2heUy5H7cGKegPjWUJjjXkVxA8zEhLmL0ruj5qWtT6vt1X7qvOx38Dq+OCNV AeVXh1QjP8tTZPmm7XcNjNwxWbe/BkdpwmQD12zvzwNZRqdm6eK9xFjY2AxjpUZql/Wn icdijEt5+r/nh/JzOBxMyTwGoqpewcYvraVIsd4BDpYuOMq0BQ7MDK7ckh5DGzDp/K6U wywMcfRllbjW0MEpdMair+0JTZIIqsxKN3v+rmKLHcX7s2YZOX+o+Za9K1SjRRuoSGak c/y2cugM9YPK+qk9AtYGYrutSWGFD6aOpVdcxhzUZSLChcCldl2ajgWZhtWB8i1DM9VY GQqA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=uiIQrqoAtqLh48nNW7BxBTk9I50dmV9fOfGOr8kEqAg=; b=GSvcg1U1hrqzv7TLka968LX6O7/PpFQFNXsCGG61Lm3jQoQjTwSuxwK71ZAlba/JDc +3WdYns+hcbgvpQUWPeyWfygd8M5ZFIp7/w59GeoDyGLm8cJcwCwfj/AsGKRCBLcQUcO 8RQ+Dk63w7UUPzUcUqqr1CrP+JFeKWnIpQM/Htul4gsz2eS/EH14EJYFnHDaX72FN5z/ JQxcDMbSTaTnG2gP/nlveLOIFwfhmK7cxUsAwz5k0LQeoJuw2EcYS4V8Tmhf+OUWk4N2 o0vT09XoDxajlKpcKNwSJoTQWzVwUep8XMW19gqjx3oRE514EyxfEZKJGLvDCT1RWVGh zAcg== X-Gm-Message-State: AG10YORgaYyVmMtCyw0rOOd+inOuQK+nb8dAJRRmXX390SMVAwhwbBlXi2+bl2rtevuwyHbJe236m/3ZMRozHA== MIME-Version: 1.0 X-Received: by 10.13.254.195 with SMTP id o186mr23278026ywf.169.1455136202586; Wed, 10 Feb 2016 12:30:02 -0800 (PST) Received: by 10.37.223.129 with HTTP; Wed, 10 Feb 2016 12:30:02 -0800 (PST) In-Reply-To: References: Date: Wed, 10 Feb 2016 12:30:02 -0800 Message-ID: Subject: Re: distributing load across cluster From: Ted Yu To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=94eb2c05d8087483a0052b704c13 --94eb2c05d8087483a0052b704c13 Content-Type: text/plain; charset=UTF-8 Here is output from cfstats: http://pastebin.com/W4FVd4RW The keyspace was created as described in https://github.com/cloudius-systems/osv/wiki/Benchmarking-Cassandra-and-other-NoSQL-databases-with-YCSB Data was loaded by using ycsb. Cheers On Wed, Feb 10, 2016 at 12:26 PM, Jack Krupansky wrote: > Sorry, I didn't realize you were still living in the stone age with DSE - > and Cassandra 2.1. Chnage "table" to "cf" (column family.) > > -- Jack Krupansky > > On Wed, Feb 10, 2016 at 3:23 PM, Ted Yu wrote: > >> I don't see tablestats sub-command: >> >> http://pastebin.com/XwwCAqh4 >> >> This is DSE 4.8.4 >> >> Cheers >> >> On Wed, Feb 10, 2016 at 12:05 PM, Jack Krupansky < >> jack.krupansky@gmail.com> wrote: >> >>> What do your partition and cluster keys look like? >>> >>> Check a nodetool tablestats to see number of partition keys on the >>> nodes. Also check nodetool tablehistograms to see if you have a lot of >>> too-wide rows due to the balance of data between the partition key and >>> clustering columns. >>> >>> -- Jack Krupansky >>> >>> On Wed, Feb 10, 2016 at 2:54 PM, Ted Yu wrote: >>> >>>> Hi, >>>> I am following this guide on a 5 node cluster: >>>> >>>> https://github.com/cloudius-systems/osv/wiki/Benchmarking-Cassandra-and-other-NoSQL-databases-with-YCSB >>>> >>>> I am using ycsb-0.5.0 >>>> >>>> I found that some node receives above average writes, leading to disk >>>> full condition. >>>> >>>> I want to get some suggestion on how the load can be better distributed. >>>> >>>> Thanks >>>> >>> >>> >> > --94eb2c05d8087483a0052b704c13 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Here is output from cfstats:
Data was loaded by using ycsb.

Cheers=



On Wed, Feb 10, 2016 at 12:26 PM, Jack Krupansky <= span dir=3D"ltr"><jack.krupansky@gmail.com> wrote:
Sorry, I didn't realize you were still l= iving in the stone age with DSE - and Cassandra 2.1. Chnage "table&quo= t; to "cf" (column family.)

-- Jack Krupansky

On Wed, Feb 10, 2016 at 3:23 PM, Ted Yu <= yuzhihong@gmail.com> wrote:
I don't see=C2=A0tab= lestats sub-command:

This is DSE 4.8.4=

Cheers

On Wed, Feb 10, 2016 at 12:05 PM, Jack= Krupansky <jack.krupansky@gmail.com> wrote:
What do your partition and clust= er keys look like?

Check a nodetool tablestats to see nu= mber of partition keys on the nodes. Also check=C2=A0nodetool tablehistograms= =C2=A0to see if you have a lot of too-wide rows due to the balance of data = between the partition key and clustering columns.

-- Jack Krupansky

On Wed, Feb 10, 2016 at 2:54 PM, Ted Yu <= yuzhihong@gmail.com> wrote:
Hi,
I am following this guide on a 5 node cluster:

I am using=C2=A0ycsb-= 0.5.0

I found that some node receives above averag= e writes, leading to disk full condition.

I want t= o get some suggestion on how the load can be better distributed.
=
Thanks




--94eb2c05d8087483a0052b704c13--