Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9A763FCC0 for ; Thu, 28 Mar 2013 14:19:08 +0000 (UTC) Received: (qmail 93661 invoked by uid 500); 28 Mar 2013 14:09:58 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 93010 invoked by uid 500); 28 Mar 2013 14:09:57 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 92934 invoked by uid 500); 28 Mar 2013 14:09:54 -0000 Delivered-To: apmail-incubator-cassandra-user@incubator.apache.org Received: (qmail 92924 invoked by uid 99); 28 Mar 2013 14:09:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Mar 2013 14:09:54 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of lccalicia@gmail.com designates 74.125.83.42 as permitted sender) Received: from [74.125.83.42] (HELO mail-ee0-f42.google.com) (74.125.83.42) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Mar 2013 14:09:49 +0000 Received: by mail-ee0-f42.google.com with SMTP id b47so4775085eek.1 for ; Thu, 28 Mar 2013 07:09:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=tKDQxhELbpXljGXJUE/PVQeFJr5qBnktEk6qdSZl5RM=; b=xw8/c8+uR92jLOGVQ5PjC1/nb85St1JfMsK2veTqfHpXlXj+luP1txIFb78hmGHfaI c1iMSoC2KjPuiAxV4AglXnqB21wsW6kgKS9x9wy7roDyQK/wS1gthVyqJUZPKv8TfsH0 oBkzTCgY5qt9BA9KgO+NkWiGXGWH79xo5HxWLviH2Wa49/XGqsuMEYQG9ekjBRPHwHjA BNu4PTVjGza6mM/M6G77/BUo1zdyY+0JJe/ogFWfmuf6LSC5fP0Fi8xMtmfo0nhzLAb5 1ATwHtayUKr+1OMifYLB6N2a8vu1JVYocb4ih2Xz6Hep2ocI5dDUUhuxwp1yoTHIU946 qY3w== MIME-Version: 1.0 X-Received: by 10.15.36.67 with SMTP id h43mr66692230eev.5.1364479768048; Thu, 28 Mar 2013 07:09:28 -0700 (PDT) Received: by 10.223.78.142 with HTTP; Thu, 28 Mar 2013 07:09:27 -0700 (PDT) In-Reply-To: References: Date: Thu, 28 Mar 2013 22:09:27 +0800 Message-ID: Subject: Re: Vnodes - HUNDRED of MapReduce jobs From: Alicia Leong To: user@cassandra.apache.org Cc: cassandra-user@incubator.apache.org Content-Type: multipart/alternative; boundary=089e0160c820e0e55704d8fcb30a X-Virus-Checked: Checked by ClamAV on apache.org --089e0160c820e0e55704d8fcb30a Content-Type: text/plain; charset=ISO-8859-1 Thanks Cem for your confirmation on this. I guess, Login > Create Issue at https://issues.apache.org/jira/browse/CASSANDRA On Thu, Mar 28, 2013 at 9:40 PM, cem wrote: > Hi Alicia , > > Cassandra input format creates mappers as many as vnodes. It is a known > issue. You need to lower the number of vnodes :( > > I have a simple solution for that and ready to write a patch. Should I > create a ticket about that? I don't know the procedure about that. > > Regards, > Cem > > > On Thu, Mar 28, 2013 at 2:30 PM, Alicia Leong wrote: > >> Hi All, >> >> I have 3 nodes of Cassandra 1.2.3 & edited the cassandra.yaml for vnodes. >> >> When I execute a M/R job .. the console showed HUNDRED of Map tasks. >> >> May I know, is the normal since is vnodes? If yes, this have slow the >> M/R job to finish/complete. >> >> >> Thanks >> > > --089e0160c820e0e55704d8fcb30a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Thanks Cem for your confirmation on this.
=
I guess, Login > Create Issue at=A0https://issues.apache.org/jira/browse= /CASSANDRA




On Thu, Mar 28, 2013 at 9:40 PM, c= em <cayiroglu@gmail.com> wrote:
Hi=A0Alicia=A0,

Cassandra= input format creates mappers as many as vnodes. It is a known issue. You n= eed to lower the number of vnodes :(

I have a simple solution for that and ready to write a = patch. Should I create a ticket about that? I=A0don't=A0know the proced= ure about that.

=A0Regards,
Cem =A0

On Thu, Mar 28, 2013 at 2:30 PM, Alicia Leo= ng <lccalicia@gmail.com> wrote:
Hi All,

= I have 3 nodes of Cassandra 1.2.3 & edited the cassandra.yaml for vnode= s.

When I execute a M/R job .. the console showed HUNDRED = of Map tasks.

May I know, is the normal since is vnodes? =A0If yes, t= his have slow the M/R job to finish/complete.


=
Thanks=A0


--089e0160c820e0e55704d8fcb30a--