Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0C5EDF5DC for ; Wed, 8 May 2013 02:32:02 +0000 (UTC) Received: (qmail 31549 invoked by uid 500); 8 May 2013 02:31:59 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 31486 invoked by uid 500); 8 May 2013 02:31:59 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 31476 invoked by uid 99); 8 May 2013 02:31:59 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 May 2013 02:31:59 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of marcosluis2186@gmail.com designates 209.85.219.44 as permitted sender) Received: from [209.85.219.44] (HELO mail-oa0-f44.google.com) (209.85.219.44) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 May 2013 02:31:54 +0000 Received: by mail-oa0-f44.google.com with SMTP id n12so1501057oag.17 for ; Tue, 07 May 2013 19:31:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:cc:content-type; bh=EG3e/V60CsbMAq3qh2apwKJhhvf9NsCjwdlhJ3oimOc=; b=zbqcHfoVlSyX53cYIsmErKGVwCXZb+j4q5wnxwAkgmHTzX6bxpFP52VGlyAsI5TZek J1obGZDgae9okLhUUa9RvlJW4epQmZ7Q8hweaIIKjfPXlt9JHkpUnVxiV03naiqhKcQ4 QQpm7H8O31/cnfL2sDU0RzNPJODgJYKhZSzGTIEyPr3CCGlHXkwyrWKLBggC+fJvzhS3 +Iu2hLt5RHmla8l9B3wAbk5g4VLFnUYj0rRRJFu1RBhozVK9hpY8evJ8vF3Z9YafZghw ErdUoNhW50sJGkR8uC4njm4Hd2pq2BZ88SWdDKE1c5yLKpLi/opq7u2Pee8vY39DwsLu jk+A== X-Received: by 10.60.117.135 with SMTP id ke7mr1400307oeb.55.1367980293131; Tue, 07 May 2013 19:31:33 -0700 (PDT) MIME-Version: 1.0 Received: by 10.60.26.39 with HTTP; Tue, 7 May 2013 19:31:13 -0700 (PDT) In-Reply-To: References: From: Marcos Luis Ortiz Valmaseda Date: Tue, 7 May 2013 22:01:13 -0430 Message-ID: Subject: Re: EC2 Elastic MapReduce HBase install recommendations To: paul.konyves@gmail.com Cc: user@hbase.apache.org Content-Type: multipart/alternative; boundary=047d7b41cd7e6e933404dc2bbbe7 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b41cd7e6e933404dc2bbbe7 Content-Type: text/plain; charset=ISO-8859-1 I think that Andrew talked about this some years ago and he created some scripts for that. You can find them here: https://github.com/apurtell/hbase-ec2 Then, you can review some links about this topic: http://blog.cloudera.com/blog/2012/10/set-up-a-hadoophbase-cluster-on-ec2-in-about-an-hour/ http://my.safaribooksonline.com/book/databases/storage-systems/9781849517140/1dot-setting-up-hbase-cluster/id286696951 http://whynosql.com/why-we-run-our-hbase-on-ec2/ You can read the HBase on EC2 demo from Andrew in the HBaseCon 2012: https://github.com/apurtell/ec2-demo 2013/5/7 Pal Konyves > Hi, > > Has anyone got some recommendations about running HBase on EC2? I am > testing it, and so far I am very disappointed with it. I did not change > anything about the default 'Amazon distribution' installation. It has one > MasterNode and two slave nodes, and write performance is around 2500 small > rows per sec at most, but I expected it to be way better. Oh, and this is > with batch put operations with autocommit turned off, where each batch > containes about 500-1000 rows... When I do it with autocommit, it does not > even reach the 1000 rows per sec. > > Every nodes were m1.Large ones. > > Any experiences, suggestions? Is it worth to try the RMap distribution > instead of the amazon one? > > Thanks, > Pal > -- Marcos Ortiz Valmaseda Product Manager at PDVSA http://about.me/marcosortiz --047d7b41cd7e6e933404dc2bbbe7--