Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 41D3F106D4 for ; Tue, 11 Mar 2014 15:27:52 +0000 (UTC) Received: (qmail 34753 invoked by uid 500); 11 Mar 2014 15:27:44 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 34627 invoked by uid 500); 11 Mar 2014 15:27:43 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 34604 invoked by uid 99); 11 Mar 2014 15:27:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Mar 2014 15:27:43 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [66.111.4.27] (HELO out3-smtp.messagingengine.com) (66.111.4.27) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Mar 2014 15:27:39 +0000 Received: from compute2.internal (compute2.nyi.mail.srv.osa [10.202.2.42]) by gateway1.nyi.mail.srv.osa (Postfix) with ESMTP id CD9B621227 for ; Tue, 11 Mar 2014 11:27:17 -0400 (EDT) Received: from web5 ([10.202.2.215]) by compute2.internal (MEProxy); Tue, 11 Mar 2014 11:27:17 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=message-id:from:to:mime-version :content-transfer-encoding:content-type:subject:date; s=smtpout; bh=afFPG0AOrdFSE9gDoeXmygMpBSg=; b=UY8V29MnNMZsEyQVAAzMC9CRqGae /M1mRHtkyzU7gmuFa3yAXVcB1gcfQ9/A6wIbihdaT4zDz9oqtEQZiYgNREjKURcW KrEFfJaEwUnH/dhESfklnY271Y+PLN7Yu7OslBe35mZdVPqst5o7tvWpJf5zi9zy gbIqAYvggHibpfE= Received: by web5.nyi.mail.srv.osa (Postfix, from userid 99) id EEC10B60C5B; Tue, 11 Mar 2014 11:27:16 -0400 (EDT) Message-Id: <1394551636.1522.93172657.21D0C6FD@webmail.messagingengine.com> X-Sasl-Enc: Dftr61K5Voo0tuqFZUqqm0SOzP9bL6ROuBr7kLC8miFf 1394551636 From: Ariel Weisberg To: user@cassandra.apache.org MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain X-Mailer: MessagingEngine.com Webmail Interface - ajax-4527a23f Subject: DSE Hadoop support for provisioning hardware Date: Tue, 11 Mar 2014 11:27:16 -0400 X-Virus-Checked: Checked by ClamAV on apache.org Hi, I am doing a presentation at Big Data Boston about how people are bridging the gap between OLTP and ingest side databases and their analytic storage and queries. One class of systems I am talking about are things like HBase and DSE that let you run map reduce against your OLTP dataset. I remember reading at some point that DSE allows you to provision dedicated hardware for map reduce, but the docs didn't seem to fully explain how that works.I looked at http://www.datastax.com/documentation/datastax_enterprise/4.0/datastax_enterprise/ana/anaStrt.html My question is what kind of provisioning can I do? Can I provision dedicated hardware for just the filesystem or can I also provision replicas that are dedicated to the file system and also serving reads for map reduce jobs. What kind of support is there for keeping OLTP reads from hitting the Hadoop storage nodes and how does this relate to doing quorum reads and writes? Thanks, Ariel