From user-return-19472-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Wed Aug 3 11:59:51 2011 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4EB50702A for ; Wed, 3 Aug 2011 11:59:51 +0000 (UTC) Received: (qmail 19729 invoked by uid 500); 3 Aug 2011 11:59:48 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 19463 invoked by uid 500); 3 Aug 2011 11:59:43 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 19455 invoked by uid 99); 3 Aug 2011 11:59:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Aug 2011 11:59:43 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a52.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Aug 2011 11:59:37 +0000 Received: from homiemail-a52.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a52.g.dreamhost.com (Postfix) with ESMTP id 5AEEC6B824F for ; Wed, 3 Aug 2011 04:59:12 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=content-type :mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; q=dns; s= thelastpickle.com; b=ZudlAoIydbyY1YIoXg2b7UZ08qjpsXBzNZPAN7Pkp/m kUFKA+0/tyZgcy9W7fK0I7p4OANNSRnvRidxiGgXztxkZL28Z7M+/+UmutszF+d3 aBIPhoqUIrtsUvH4gck1GNprqDUPMaXnDIO/XhGGqyd3G0braLUo8EgvWDpgamps = DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h= content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; s= thelastpickle.com; bh=T3qGyCGPF3X879Q4nNRYyZ7Y330=; b=XccysXpqWn 3rItU+JX6jYLrWpZMPgbhOiUe+4cEWk8iNHlXWaj/iKj4j7WIRxqQAHaCHTllme+ 2nE9FSn8GCdw1fiYALvm3xdeCQzlskcdHLRQhnRRyQ60lyad+CfvbsMvJ0i1XgzV ApPfSDS+Lk3GDaOX7+Q/sYgcfeNWfTwRA= Received: from [192.168.0.101] (CPE-124-191-124-91.pmql1.win.bigpond.net.au [124.191.124.91]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a52.g.dreamhost.com (Postfix) with ESMTPSA id E3EBB6B810E for ; Wed, 3 Aug 2011 04:59:11 -0700 (PDT) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Apple Message framework v1244.3) Subject: Re: RF=1 From: aaron morton In-Reply-To: Date: Wed, 3 Aug 2011 21:59:08 +1000 Content-Transfer-Encoding: quoted-printable Message-Id: <813E81B0-6A8C-4DAD-AB85-A5BA9C734F28@thelastpickle.com> References: <1312319458.4058.4.camel@us-wash-ch2ljq1.morningstar.com> To: user@cassandra.apache.org X-Mailer: Apple Mail (2.1244.3) If you want to take a look = o.a.c.hadoop.ColumnFamilyRecordReader.getSplits() is the function that = gets the splits.=20 Cheers=20 ----------------- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 3 Aug 2011, at 16:18, Patrik Modesto wrote: > On Tue, Aug 2, 2011 at 23:10, Jeremiah Jordan > wrote: >> If you have RF=3D1, taking one node down is going to cause 25% of = your >> data to be unavailable. If you want to tolerate a machines going = down >> you need to have at least RF=3D2, if you want to use quorum and have = a >> machine go down, you need at least RF=3D3. >=20 > I know I can have RF > 1 but I have limited resources and I don't care > lossing 25% of the data. RF > 1 basicaly means if a node goes down I > have the data elsewhere, but what I need is if node goes down just > ignore its range. I can handle it in my applications using thrift, but > the hadoop-mapreduce can't handle it. It just fails with "Exception in > thread "main" java.io.IOException: Could not get input splits". Is > there a way to say ignore this range to hadoop? >=20 > Regards, > P.